Jan 26 19:03:23.741799 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:03:23.749461 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:03:23.749640 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:04:23.757464 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:04:23.757834 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:04:43.590292 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Create backup started, backup: 9ef48299-e0b5-46db-9b78-2ba617355850 volume: 45ac36d4-0d45-4d42-8723-1353aae47e05 snapshot: 4cdbe0c9-1623-4d1d-85e9-c3a202ee7d51. Jan 26 19:04:43.596458 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-914741629',created_at=2026-01-27T00:04:43Z,data_timestamp=2026-01-27T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1232927736',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=9ef48299-e0b5-46db-9b78-2ba617355850,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c55032abafa74d4facac03929da4a366',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='4cdbe0c9-1623-4d1d-85e9-c3a202ee7d51',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d9bb266354284323ae54b4c3317c26e5',volume_id=45ac36d4-0d45-4d42-8723-1353aae47e05) Jan 26 19:04:45.337462 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_c55032abafa74d4facac03929da4a366 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:04:45.337462 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:04:45.337462 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:04:45.337462 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpeogqt5ot/privsep.sock'] Jan 26 19:04:45.351433 np0005596550.novalocal sudo[222203]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpeogqt5ot/privsep.sock Jan 26 19:04:46.109095 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Spawned new privsep daemon via rootwrap Jan 26 19:04:46.109095 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Accepted privsep connection to /tmp/tmpeogqt5ot/privsep.sock {{(pid=194750) __init__ /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:377}} Jan 26 19:04:46.109651 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [-] privsep daemon starting Jan 26 19:04:46.109814 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jan 26 19:04:46.109880 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_READ_SEARCH|CAP_SYS_ADMIN/CAP_DAC_READ_SEARCH|CAP_SYS_ADMIN/none Jan 26 19:04:46.109961 np0005596550.novalocal cinder-backup[194750]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 222207 Jan 26 19:04:46.112265 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a66f7-4e08-4211-ae83-71da1d4cd96c]: (2,) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.192050 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.199060 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:46.199185 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde31e55-3495-4c56-8396-7ee713c27ce8]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[663d82db-b2df-42f1-89e5-42082dfeeb39]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:46.201518 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:04:46.202523 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d82db-b2df-42f1-89e5-42082dfeeb39]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.202523 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:04:46.202801 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:04:46.204076 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.nvmeof [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jan 26 19:04:46.205294 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.211349 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:46.211820 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6a715b-e2fd-448e-917e-53876fc9ca61]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.215210 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.222076 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:46.222271 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[def312df-2285-462e-9766-f942d0d70d38]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.228176 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[71992601-39cf-4453-9cc9-ff878d3fc150]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:46.228615 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:46.239285 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:04:46.239592 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:04:46.241442 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:04:46.242210 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe06:2e61', 'fe80::74c7:d4ff:fe18:56ef'] Jan 26 19:04:46.242380 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:04:46.242498 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:04:46.242741 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] <== get_connector_properties: return (905ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::64f3:a5ff:fe22:3e52', 'fe80::fc16:3eff:fe5d:9ebd', 'fe80::fc16:3eff:fe06:2e61', 'fe80::74c7:d4ff:fe18:56ef']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:04:49.767835 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:04:49.767835 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a', 'target_lun': 0, 'volume_id': '85ff3a52-6e25-4054-861f-36b18350053a', 'auth_method': 'CHAP', 'auth_username': 'NDmKBgAEd9WveMBXCWys', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:04:49.767835 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:04:49.767835 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:04:49.768307 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a', 'target_lun': 0, 'volume_id': '85ff3a52-6e25-4054-861f-36b18350053a', 'auth_method': 'CHAP', 'auth_username': 'NDmKBgAEd9WveMBXCWys', 'auth_password': 'PiYkG9kcZbqhVNT8', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:04:49.770005 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:49.773132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c2abe66a-aca3-40da-bbdf-bafe39844bfa]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:04:49.778212 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:04:49.778549 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abe66a-aca3-40da-bbdf-bafe39844bfa]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:49.778872 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:04:49.779476 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:04:49.779670 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:04:49.780982 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:49.794726 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260" returned: 21 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:49.797788 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd7bf2-83dc-4483-bf72-6556206b734d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:49.797788 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:04:49.797788 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:49.797788 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:49.808203 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:49.808203 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f4fac5-e712-49ac-b598-7bcf8d21f348]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:49.808597 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a] added Jan 26 19:04:49.808597 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:04:49.808597 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:04:49.808597 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:04:49.808597 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:49.808743 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:04:49.809240 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:04:49.809439 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:04:50.811188 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:04:50.812725 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.825310 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.825796 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0becfefa-5239-4d9d-a67f-59e616b33c58]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:04:50.826661 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.830081 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.836105 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.836663 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[37939600-dd6c-4c37-b563-56eb96cb3099]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.836924 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.837406 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.845954 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.846113 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0f9fd0-e20a-4f0f-ac3d-65ebecf69684]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.846418 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.848987 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v NDmKBgAEd9WveMBXCWys {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.855897 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v NDmKBgAEd9WveMBXCWys" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.856240 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614303f-3d39-40f9-8be1-1eb515cac133]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.856594 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NDmKBgAEd9WveMBXCWys'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.857598 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.866236 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.866320 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f4b26-6082-48c8-8b24-8ee237a7531d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.866639 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.868987 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.876598 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.877050 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c2cca-2e79-4c8b-b604-e44e5ce84821]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.877497 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:04:50.877497 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:04:50.877658 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:04:50.877658 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:04:50.877858 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:04:50.877858 np0005596550.novalocal cinder-backup[194750]: Jan 26 19:04:50.878557 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.895147 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --login" returned: 0 in 0.015s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.895279 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45324f8-b6b0-4afd-9ecf-b6e5672ce4d3]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.895675 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260] successful. Jan 26 19:04:50.895675 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.896441 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.909754 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.909875 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3cf586-f729-4bf5-b10c-8a899576c1cb]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.910232 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:04:50.911986 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.921843 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.922018 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a324b7b-03fb-4767-9a5e-7213b3ddd561]: (4, ('tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.922252 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('-m', 'session'): stdout=tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash) Jan 26 19:04:50.922252 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:04:50.922400 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsi session list stdout=tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash) Jan 26 19:04:50.922400 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:04:50.922710 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:04:50.922953 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:04:50.923736 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] HCTL ('2', '-', '-', 0) found on session 7 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:04:50.923914 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:04:50.925988 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:50.961183 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.036s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:50.961260 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4fbd19-b595-4dd7-b5f8-837ffa4a3dd6]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:04:50.962087 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Searching for a device in session 7 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:04:51.963574 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Searching for a device in session 7 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:04:51.964808 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a', 'target_lun': 0, 'volume_id': '85ff3a52-6e25-4054-861f-36b18350053a', 'auth_method': 'CHAP', 'auth_username': 'NDmKBgAEd9WveMBXCWys', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:04:51.969509 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.200s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:04:51.969509 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] <== connect_volume: return (2202ms) {'type': 'block', 'scsi_wwn': '360014053904da1a028b455d8242a76a2', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:04:51.970299 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:04:52.003189 np0005596550.novalocal sudo[222394]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:04:52.341716 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.372s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:04:52.346436 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:04:52.353874 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-914741629,backup: 9ef48299-e0b5-46db-9b78-2ba617355850. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:04:53.096004 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] generate_object_name_prefix: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850 {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:04:53.111692 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] starting backup of volume: 45ac36d4-0d45-4d42-8723-1353aae47e05, volume size: 1073741824, object names prefix volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:04:53.319715 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:53.445939 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:53.446242 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:53.718667 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:53.718845 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:54.298465 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:54.447372 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:54.447679 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:54.604946 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:54.605131 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:55.184491 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:55.307071 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:55.307404 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:55.446350 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:55.446465 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:55.658086 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:55.787919 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:55.788069 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:55.902750 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:55.903083 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:56.024562 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:56.126624 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:56.126789 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:56.236391 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:56.236729 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:56.430330 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:56.525320 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:56.525501 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:56.657853 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:56.658042 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:56.808192 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:56.945623 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:56.945995 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:57.059570 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:57.059824 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:57.220435 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:57.342782 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:57.342971 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:57.464791 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:57.465128 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:57.831704 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:57.973892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:57.974044 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:58.108836 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:58.108836 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:58.277611 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:58.400785 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:58.400950 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:58.521851 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:58.522312 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:58.646848 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:58.750354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:58.750630 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:58.915363 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:58.915619 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:04:59.747893 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:04:59.851716 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:04:59.851919 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:04:59.985059 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:04:59.985178 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:00.191626 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:00.347551 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:00.347880 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:00.475888 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:00.475888 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:00.591340 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:00.693821 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:00.693821 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:00.802418 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:00.802864 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:00.942781 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:01.066399 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:01.066534 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:01.726850 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:01.727139 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:01.848419 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:01.948348 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:01.948487 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:02.085247 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:02.085408 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:02.478419 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:02.597678 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:02.597853 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:02.722319 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:02.722800 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:02.902470 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:03.008648 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:03.009162 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:03.165476 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:03.166910 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:03.314957 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:03.439866 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:03.439866 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:03.569220 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:03.571342 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:04.186628 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:04.335654 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:04.335654 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:04.473430 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:04.473430 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:04.529830 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:05:04.606778 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:05:04.607033 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:05:04.705891 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup MD5 for volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:05:04.706180 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:05:04.711258 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:05:04.720214 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:05:04.720596 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:05:04.727000 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:05:04.727275 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:05:04.732860 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:05:04.733239 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-914741629, sha256file filename: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:05:04.798732 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:05:04.798732 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-914741629, metadata filename: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:05:04.826098 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9ef48299-e0b5-46db-9b78-2ba617355850",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-1232927736",\n "created_at": "2026-01-27 00:04:43+00:00",\n "objects": [\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "45ac36d4-0d45-4d42-8723-1353aae47e05",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"45ac36d4-0d45-4d42-8723-1353aae47e05\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"d9bb266354284323ae54b4c3317c26e5\\", \\"project_id\\": \\"c55032abafa74d4facac03929da4a366\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:04:40.000000\\", \\"launched_at\\": \\"2026-01-27T00:04:40.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-2110796431\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:04:40.000000\\", \\"updated_at\\": \\"2026-01-27T00:04:40.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:05:04.829415 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] backup 9ef48299-e0b5-46db-9b78-2ba617355850 finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:05:04.913639 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:04.939062 np0005596550.novalocal sudo[222527]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:05:05.286237 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.373s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.287095 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a', 'target_lun': 0, 'volume_id': '85ff3a52-6e25-4054-861f-36b18350053a', 'auth_method': 'CHAP', 'auth_username': 'NDmKBgAEd9WveMBXCWys', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '360014053904da1a028b455d8242a76a2', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:05:05.287223 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:05:05.287966 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:05:05.288966 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.299455 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.299552 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb219cf2-612f-4e18-b272-819f6aa1a800]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:05:05.299820 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:05:05.300120 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:05:05.300120 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:05:05.300120 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:05:05.300518 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:05:05.301169 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.329127 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.329272 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f07869-f44f-4f8a-96d5-a4a01142bca6]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.331268 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.339651 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.339803 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34a09a-b682-47ab-9273-96633d97a91d]: (4, ('tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.340127 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('-m', 'session'): stdout=tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash) Jan 26 19:05:05.340127 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:05:05.340265 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsi session list stdout=tcp: [7] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a (non-flash) Jan 26 19:05:05.340265 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:05:05.340984 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Resulting device map defaultdict(. at 0x7fdaf0a4d9e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:05:05.341258 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:05:05.341751 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.346232 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[75f4597b-3510-49f7-b9ab-6be1f30a8401]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:05:05.347111 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:05:05.347968 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4597b-3510-49f7-b9ab-6be1f30a8401]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.348463 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:05:05.350841 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.356736 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.357049 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaee8af-3c79-4daa-919f-4274cfe195ca]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.357527 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:05:05.358866 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.407071 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.047s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.407516 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c7367-f566-4c94-b13d-6f17b184ad92]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.408124 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:05:05.408506 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:05:05.408985 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:05:05.412111 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.418219 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.418579 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb6b86-440d-4730-92c1-14c0879194e9]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.419172 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:05:05.420207 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --logout" returned: 0 in 0.026s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7f8b3a-0759-4c9c-9a83-769b3143978a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260] Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a, portal: 38.102.83.18,3260] successful. Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:05:05.448822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:05:05.457973 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85ff3a52-6e25-4054-861f-36b18350053a -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:05:05.458222 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[265d58af-3fbc-4825-8e32-3eacaaf399cc]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:05:05.458679 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:05:05.459110 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.171s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:05:05.459695 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] <== disconnect_volume: return (171ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:05:09.032960 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4a2ddc4c-bbe5-4e43-a360-3a56aa5a89f1 tempest-VolumesSnapshotTestJSON-666453103 None] Create backup finished. backup: 9ef48299-e0b5-46db-9b78-2ba617355850. Jan 26 19:05:09.293892 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] Delete backup started, backup: 9ef48299-e0b5-46db-9b78-2ba617355850. Jan 26 19:05:09.293892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_c55032abafa74d4facac03929da4a366 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:05:09.293892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:05:09.293892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] delete started, backup: 9ef48299-e0b5-46db-9b78-2ba617355850, container: tempest-volumessnapshottestjson-backup-container-914741629, prefix: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:05:09.346792 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] generated object list: ['volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00001', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00002', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00003', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00004', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00005', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00006', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00007', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00008', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00009', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00010', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00011', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00012', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00013', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00014', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00015', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00016', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00017', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00018', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00019', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00020', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00021', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_metadata', 'volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:05:09.374055 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00001 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.393892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00002 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.416227 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00003 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.436741 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00004 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.458953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00005 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.483090 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00006 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.512966 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00007 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.535339 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00008 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.559979 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00009 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.581244 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00010 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.600956 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00011 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.619982 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00012 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.644369 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00013 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.667255 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00014 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.685458 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00015 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.712079 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00016 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.739219 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00017 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.769544 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00018 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.792113 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00019 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.818772 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00020 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.838666 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850-00021 in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.868887 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_metadata in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.904925 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] deleted object: volume_45ac36d4-0d45-4d42-8723-1353aae47e05/20260127000453/az_nova_backup_9ef48299-e0b5-46db-9b78-2ba617355850_sha256file in container: tempest-volumessnapshottestjson-backup-container-914741629. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:05:09.904925 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] delete 9ef48299-e0b5-46db-9b78-2ba617355850 finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:05:09.908193 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:05:09.963808 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] Created reservations ['e7494933-141e-4979-8804-5009a799c673', 'a4b52e77-ac2d-463b-a657-d6ab83df1fd6'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:05:09.998483 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-3b597cf6-070e-4eed-b2fe-591e6d3cfabb tempest-VolumesSnapshotTestJSON-666453103 None] Delete backup finished, backup 9ef48299-e0b5-46db-9b78-2ba617355850 deleted. Jan 26 19:05:23.739090 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=42,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:05:23.754952 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:05:23.755119 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:06:23.759356 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:06:23.759720 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:07:23.741961 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:07:23.764023 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:07:23.764263 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:08:23.761526 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:08:23.761887 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:09:23.741436 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:09:23.766227 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:09:23.766463 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:10:23.768077 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:10:23.768077 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:11:23.739733 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:11:23.771595 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:11:23.771728 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:11:42.925616 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: e4b624ea-c67f-4726-b3b7-0971d80eb396 volume: 7b99cea9-3a13-452e-9141-efcbb218f28b. Jan 26 19:11:42.931198 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1397569414',created_at=2026-01-27T00:11:42Z,data_timestamp=2026-01-27T00:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1951189700',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=e4b624ea-c67f-4726-b3b7-0971d80eb396,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=7b99cea9-3a13-452e-9141-efcbb218f28b) Jan 26 19:11:44.394120 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:11:44.394516 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:11:44.394637 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:11:44.395862 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:44.402278 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:44.402422 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[11336e15-7a3f-41ac-bc0e-09fd56ab3a4b]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[727ab3e3-a00e-442f-ba3f-d94755f6c53e]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:44.405257 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:11:44.405808 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[727ab3e3-a00e-442f-ba3f-d94755f6c53e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:44.406226 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:11:44.406436 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:11:44.407283 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:44.421051 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:44.421848 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[39138a3d-ce78-4202-8815-bcc131f7b7e9]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:44.422603 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:44.435650 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:44.435843 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d03573-ec20-4083-9857-47f1a5fb952e]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:44.436824 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[91414126-c05f-4dbb-8eae-53cdd038ab61]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:44.437130 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:44.447797 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:11:44.448034 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:11:44.450296 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:11:44.451190 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d', 'fe80::fc16:3eff:fe34:8425', 'fe80::b4c2:8aff:fe71:de47'] Jan 26 19:11:44.451344 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:11:44.451503 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:11:44.451854 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe8b:fccc', 'fe80::80c9:38ff:fe93:555d', 'fe80::fc16:3eff:fe34:8425', 'fe80::b4c2:8aff:fe71:de47']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:47.960986 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:11:47.961745 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'target_lun': 0, 'volume_id': '3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'auth_method': 'CHAP', 'auth_username': 'rZ55TTiwwKDgXVR5YnB9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:11:47.962080 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:11:47.962893 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:11:47.963096 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'target_lun': 0, 'volume_id': '3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'auth_method': 'CHAP', 'auth_username': 'rZ55TTiwwKDgXVR5YnB9', 'auth_password': '6U7hgEZSj4LefmMw', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:11:47.963901 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:47.968548 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[cb35748f-a83d-45d4-8e6b-97b578037044]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:11:47.969685 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:11:47.970807 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb35748f-a83d-45d4-8e6b-97b578037044]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:47.971418 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:11:47.971829 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:11:47.972076 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:11:47.973052 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:47.983863 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260" returned: 21 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:47.984030 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a716d-cb0f-429f-bccd-63e9a6577f98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:47.984347 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:11:47.984347 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:47.985155 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:47.994228 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:47.994398 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dbe10b-9c1b-4f9a-b8af-cb287066da5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:47.994690 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2] added Jan 26 19:11:47.994690 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:11:47.994690 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:11:47.994690 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:11:47.994690 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:47.994873 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:11:47.995341 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:11:47.995541 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:11:48.996400 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:11:48.997237 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260" returned: 0 in 0.031s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[034da321-0e41-4792-bafe-340f38a98621]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:11:49.030192 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.031865 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.040338 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.040673 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b5e79b-6b7b-4a6a-afe8-22f46ed14ff4]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.041004 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.042551 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.053797 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.053797 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0105a-8dab-446b-b304-18fc542b2f9d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.053797 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.054458 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v rZ55TTiwwKDgXVR5YnB9 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.065088 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v rZ55TTiwwKDgXVR5YnB9" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.065088 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebe256-a5e3-4345-a673-1f7addfbe9b0]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.065286 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rZ55TTiwwKDgXVR5YnB9'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.066051 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.075153 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.075266 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5365d-3ec3-4447-963d-ecb94fa43a17]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.075630 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.077975 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.084167 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.084324 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fad1a0-89ab-4fd2-ba08-9f29481dcc61]: (4, ('tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.084666 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:49.084666 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:49.084912 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:49.084912 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:49.086934 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.099264 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --login" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.099403 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[57057ffc-8917-4cbf-b5c6-b1dfcef26fbd]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.099800 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260] successful. Jan 26 19:11:49.099800 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.100405 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.108536 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.108653 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71f59d8-9ad8-4629-b9f1-84072b658f6c]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.108973 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:11:49.109573 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.118114 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.118226 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155ada6-7b0f-4cb1-9f3e-9b05aef21b09]: (4, ('tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\ntcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.118490 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:49.118490 np0005596550.novalocal cinder-backup[194750]: tcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash) Jan 26 19:11:49.118490 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:11:49.118618 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:11:49.118618 np0005596550.novalocal cinder-backup[194750]: tcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash) Jan 26 19:11:49.118618 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:11:49.118927 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:49.119020 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:11:49.119429 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] HCTL ('2', '-', '-', 0) found on session 16 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:11:49.119552 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:11:49.120143 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:49.139658 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:49.139658 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5cc86-2049-4e7e-b40b-914d4b74bf08]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:11:49.139658 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 16 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:50.140585 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 16 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:11:50.141165 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'target_lun': 0, 'volume_id': '3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'auth_method': 'CHAP', 'auth_username': 'rZ55TTiwwKDgXVR5YnB9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:11:50.141752 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:11:50.142007 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2180ms) {'type': 'block', 'scsi_wwn': '3600140575912c9dd849403290e13dd09', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:11:50.142431 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:11:50.164261 np0005596550.novalocal sudo[229156]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:11:50.511431 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.368s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:11:50.515742 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:11:50.530351 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1397569414,backup: e4b624ea-c67f-4726-b3b7-0971d80eb396. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:11:50.921923 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396 {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:11:50.925948 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] starting backup of volume: 7b99cea9-3a13-452e-9141-efcbb218f28b, volume size: 1073741824, object names prefix volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:11:51.292364 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:51.413657 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:51.413830 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:51.578425 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:51.578595 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:51.698046 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:51.799486 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:51.799585 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:51.932308 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:51.932431 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:52.089522 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:52.200258 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:52.200390 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:52.323964 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:52.324136 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:52.432614 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:52.544949 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:52.545108 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:52.658790 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:52.658988 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:52.790174 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:52.918496 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:52.918751 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:53.037288 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:53.037431 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:53.152135 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:53.255807 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:53.255900 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:53.378182 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:53.378631 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:53.500172 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:53.599627 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:53.599807 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:53.712862 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:53.713016 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:54.097541 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:54.203102 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:54.203102 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:54.345467 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:54.345613 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:54.674845 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:54.798458 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:54.798579 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:55.000480 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:55.000630 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:55.148476 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:55.340954 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:55.340954 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:55.478848 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:55.478848 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:55.634256 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:55.794380 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:55.794709 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:55.917499 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:55.917800 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:56.292350 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:56.412673 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:56.412831 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:56.615112 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:56.615239 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:56.744556 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:56.866930 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:56.867432 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:56.986601 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:56.986728 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:57.560632 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:57.670992 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:57.672932 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:57.939850 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:57.940290 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:58.481461 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:58.601994 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:58.602144 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:58.715684 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:58.715854 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:59.130809 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:59.272094 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:59.272275 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:59.415655 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:59.415821 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:11:59.611887 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:11:59.735544 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:11:59.735826 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:11:59.890253 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:11:59.890253 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:00.046923 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:00.157487 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:00.157487 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:00.280427 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:00.280427 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:00.424874 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:00.572647 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:00.573525 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:00.705055 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:00.705176 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:01.088912 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:01.196212 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:01.196722 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:01.340881 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:01.341070 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:01.414047 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:01.480287 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:01.480565 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:01.566709 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:01.566884 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:01.571592 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:12:01.579703 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:12:01.579899 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:12:01.583211 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:12:01.583420 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:12:01.586119 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:12:01.586372 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1397569414, sha256file filename: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:12:02.099298 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:12:02.100306 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1397569414, metadata filename: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:12:02.147799 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "e4b624ea-c67f-4726-b3b7-0971d80eb396",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1951189700",\n "created_at": "2026-01-27 00:11:42+00:00",\n "objects": [\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7b99cea9-3a13-452e-9141-efcbb218f28b",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7b99cea9-3a13-452e-9141-efcbb218f28b\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:10:37.000000\\", \\"launched_at\\": \\"2026-01-27T00:10:38.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-220218431\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b 0\\", \\"provider_auth\\": \\"CHAP xAMSGov4NR4iBpfuFrd8 vVVAhujfDMw8unuk\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:10:37.000000\\", \\"updated_at\\": \\"2026-01-27T00:11:42.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:12:02.154754 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] backup e4b624ea-c67f-4726-b3b7-0971d80eb396 finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:12:02.247291 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.272210 np0005596550.novalocal sudo[229348]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:12:02.652144 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.405s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.653204 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'target_lun': 0, 'volume_id': '3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 'auth_method': 'CHAP', 'auth_username': 'rZ55TTiwwKDgXVR5YnB9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3600140575912c9dd849403290e13dd09', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:02.653386 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:02.654275 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:02.656884 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22516bb-6853-4f82-80ba-cd588b32d605]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:12:02.714132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.723965 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.724098 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[199e3b74-5615-49a2-aa62-5ac31d6ad0c1]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.724785 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.735699 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.736341 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[668baee0-67c1-4754-877b-bc12003e800b]: (4, ('tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash)\ntcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.736578 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:12:02.736578 np0005596550.novalocal cinder-backup[194750]: tcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash) Jan 26 19:12:02.736578 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:02.736702 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [15] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-7b99cea9-3a13-452e-9141-efcbb218f28b (non-flash) Jan 26 19:12:02.736702 np0005596550.novalocal cinder-backup[194750]: tcp: [16] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 (non-flash) Jan 26 19:12:02.736702 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:02.737403 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23b94e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:12:02.737590 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:12:02.738292 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.743401 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fdc16e51-44c9-40ff-83eb-920fbb17926d]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:02.745349 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:02.747223 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc16e51-44c9-40ff-83eb-920fbb17926d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.747577 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:12:02.749473 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.753833 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.753833 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[25791201-895b-48b5-8abe-7ac5dc0b0c5d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.753936 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:12:02.755735 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.796856 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.042s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.797087 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179bcdd-5f6e-4061-beb5-fef9c39ac23c]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.797476 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:12:02.797705 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:12:02.798439 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:12:02.799247 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.811851 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.812013 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab4863-31f1-406d-97f7-442b328a5822]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.812401 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:02.813277 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.840540 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --logout" returned: 0 in 0.027s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.840651 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0653dc3e-1260-447e-a375-491f3df20f9c]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.840989 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260] Jan 26 19:12:02.840989 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2, portal: 38.102.83.18,3260] successful. Jan 26 19:12:02.840989 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:02.841781 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:02.851836 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-3688e2f1-1cb3-48e8-bffd-1d3a4b8848f2 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:02.851957 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f11b4-38ef-49de-9792-cc1d657eba81]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:02.852202 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:02.852420 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:02.852553 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (198ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:06.401760 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-9ac07ad3-9f7c-4ec6-8c32-b970956a5d0c tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: e4b624ea-c67f-4726-b3b7-0971d80eb396. Jan 26 19:12:06.613437 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: e4b624ea-c67f-4726-b3b7-0971d80eb396. Jan 26 19:12:06.614286 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:12:06.614410 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:12:06.614572 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] delete started, backup: e4b624ea-c67f-4726-b3b7-0971d80eb396, container: tempest-volumesbackupstest-backup-container-1397569414, prefix: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:12:06.711398 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00001', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00002', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00003', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00004', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00005', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00006', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00007', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00008', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00009', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00010', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00011', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00012', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00013', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00014', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00015', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00016', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00017', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00018', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00019', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00020', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00021', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_metadata', 'volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:12:06.743732 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00001 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.767139 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00002 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.792110 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00003 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.824054 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00004 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.846937 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00005 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.868670 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00006 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.890308 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00007 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.908279 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00008 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.931412 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00009 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.951409 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00010 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:06.973603 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00011 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.001143 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00012 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.028894 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00013 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.052500 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00014 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.071781 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00015 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.096189 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00016 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.120237 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00017 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.145728 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00018 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.171741 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00019 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.193008 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00020 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.213899 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396-00021 in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.233374 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_metadata in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.263395 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] deleted object: volume_7b99cea9-3a13-452e-9141-efcbb218f28b/20260127001150/az_nova_backup_e4b624ea-c67f-4726-b3b7-0971d80eb396_sha256file in container: tempest-volumesbackupstest-backup-container-1397569414. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:12:07.263564 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] delete e4b624ea-c67f-4726-b3b7-0971d80eb396 finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:12:07.266357 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:12:07.296455 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] Created reservations ['0d72110a-9e30-43e1-bebb-9951bfb69d27', '20167770-6e30-4d5e-85d3-a80c8b123b44'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:12:07.324999 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-8a490b31-6ff7-4658-9e67-11c5983803ae tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup e4b624ea-c67f-4726-b3b7-0971d80eb396 deleted. Jan 26 19:12:17.322676 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:12:23.771368 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:12:23.771653 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:12:25.923026 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 volume: b6214f03-b8e1-4484-94a1-ccba3b65c5d9. Jan 26 19:12:25.946701 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1130551473',created_at=2026-01-27T00:12:25Z,data_timestamp=2026-01-27T00:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1451819015',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=77a1d870-40f5-4ca3-ac11-2d7fe6afc487,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=b6214f03-b8e1-4484-94a1-ccba3b65c5d9) Jan 26 19:12:25.973812 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:12:25.973812 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:12:25.974317 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:25.975742 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:25.983277 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:25.983506 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376395b-27c7-4f2c-9f21-ee672cbcdfe5]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[09aaf0ac-ec16-486c-ae86-ffdb0d6ae385]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:25.985101 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:12:25.986246 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aaf0ac-ec16-486c-ae86-ffdb0d6ae385]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:25.986246 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:12:25.986246 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:12:25.986663 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:25.994890 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:25.995157 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d4a49-478e-4195-a6bf-d1147e14e0d7]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:25.996246 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:26.003710 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:26.004011 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5abf4-5abd-4de2-afcb-16a76870328a]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:26.004861 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[45adb4a2-d431-471e-9277-5b08dfe2b8be]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:26.005341 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:26.016562 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:26.016893 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:12:26.019849 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:12:26.019849 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf'] Jan 26 19:12:26.019849 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:12:26.019849 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:12:26.019849 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (44ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:29.527892 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:12:29.528520 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'target_lun': 0, 'volume_id': 'b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'auth_method': 'CHAP', 'auth_username': 'hopBLzfWFt2XeYRxKCso', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:29.528660 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:29.529077 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:29.529215 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'target_lun': 0, 'volume_id': 'b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'auth_method': 'CHAP', 'auth_username': 'hopBLzfWFt2XeYRxKCso', 'auth_password': 'kxVjaFZyFh4bVS9D', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:12:29.530029 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:29.534604 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6bbb0bde-3abf-4174-a4ca-a7fe0acd8381]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:29.536099 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:29.536969 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb0bde-3abf-4174-a4ca-a7fe0acd8381]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:29.537472 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:29.537861 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:29.538076 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:29.539004 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:29.546986 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260" returned: 21 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:29.547151 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f9159d-dc80-4d2c-87fc-44e8cc6a92f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:29.547434 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:12:29.547434 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:29.548221 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:29.554691 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:29.555019 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb19f88-4a9f-4e70-97ce-d3d1515e4732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:29.555293 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9] added Jan 26 19:12:29.555293 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:12:29.555293 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:29.555293 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:29.555293 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:29.555470 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:12:29.555865 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.018(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:12:29.556062 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:12:30.557701 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:30.561276 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.567699 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[198802b6-691f-4daa-9d73-7b123c3c86c1]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.570316 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.578842 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.578842 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4c2a2-1da7-4e87-937f-6a30f015e181]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.579163 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.580096 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.588409 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.589101 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bb564c-75b7-4181-a877-728313247faf]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.589489 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.590497 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v hopBLzfWFt2XeYRxKCso {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.601064 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v hopBLzfWFt2XeYRxKCso" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.601248 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc575a2-aab1-407e-9721-328332da3ccc]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.601709 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hopBLzfWFt2XeYRxKCso'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.602911 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.612141 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.612619 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc19ce-82f4-4ead-b964-f56a74c28d6e]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.613153 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.613887 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.621130 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.621573 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2b907-ca69-444b-93ad-3f9fc06ec23e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.621946 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:12:30.621946 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:30.622136 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:12:30.622136 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:30.622327 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:12:30.622327 np0005596550.novalocal cinder-backup[194750]: Jan 26 19:12:30.624017 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.634647 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --login" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.635132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d6c5c-c55f-4515-82d6-97553d660602]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.635440 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260] successful. Jan 26 19:12:30.635440 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.636322 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.645140 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.645140 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5fb341-541e-4970-ac09-ee364fe9f3ec]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.645188 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:30.646294 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.655128 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.655128 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[db75d512-ebe9-464d-9ced-a407e961b0e1]: (4, ('tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.655579 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:30.655579 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:30.655754 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:30.655754 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:30.656290 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:30.656496 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:12:30.657177 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] HCTL ('2', '-', '-', 0) found on session 17 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:12:30.657343 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:12:30.658150 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:30.676984 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.019s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:30.677148 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cecf477-3325-44a7-9bb4-05660e738cd8]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:30.677701 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 17 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:31.679287 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 17 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:31.679951 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'target_lun': 0, 'volume_id': 'b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'auth_method': 'CHAP', 'auth_username': 'hopBLzfWFt2XeYRxKCso', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:12:31.680179 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:31.680246 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': '36001405e3b0f39c504b4f5998fd9cad7', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:31.680608 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:31.700407 np0005596550.novalocal sudo[229933]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:12:32.017082 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.336s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:32.023231 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:12:32.038444 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1130551473,backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:12:32.152436 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487 {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:12:32.158160 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] starting backup of volume: b6214f03-b8e1-4484-94a1-ccba3b65c5d9, volume size: 1073741824, object names prefix volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:12:32.396853 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:32.973945 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 19857195 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:32.973945 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:33.236818 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001: 82571f7121cb9475563edde615e4e4df {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:33.236986 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:33.462170 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:33.579241 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:33.579368 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:33.721255 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:33.721384 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:33.850604 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:34.008350 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 1362431 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:34.008799 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:34.132838 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003: a35891500449df17e893f84bd88472fb {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:34.132838 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:34.264368 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:34.458136 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:34.458136 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:34.576433 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:34.576433 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:34.703321 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:34.834893 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:34.835180 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:34.960204 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:34.960397 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:35.317622 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:35.417120 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:35.417257 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:35.582450 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:35.582620 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:36.131573 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:36.247013 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:36.247205 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:36.351721 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:36.351721 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:36.463845 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:36.609453 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:36.609555 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:36.715561 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:36.715726 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:36.831053 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:36.934532 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:36.935079 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:37.052366 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:37.052549 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:37.159237 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:37.259586 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:37.259750 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:37.372953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:37.373386 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:37.541963 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:37.655947 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:37.656245 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:37.775206 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:37.776291 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:37.909131 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:38.009368 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:38.009543 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:38.152345 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:38.152477 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:38.269075 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:38.374179 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:38.375082 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:38.491527 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:38.491707 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:38.642591 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:38.749966 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:38.750107 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:38.867595 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:38.867821 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:39.069111 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:39.210910 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:39.211164 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:39.798726 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:39.799389 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:39.958620 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:40.090031 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:40.090031 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:40.229143 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:40.229446 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:40.383852 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:40.484943 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:40.485218 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:40.612988 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:40.613831 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:40.973728 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:41.101954 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:41.102071 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:41.296598 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:41.296816 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:41.626551 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:41.737338 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:41.737338 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:41.871254 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:41.871410 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:42.035921 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:42.243450 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:42.243689 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:42.436151 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:42.436295 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:42.747213 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:12:42.850476 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:12:42.851117 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:12:42.941818 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:12:42.942029 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:12:42.950954 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:12:42.961329 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:12:42.961537 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:12:42.965868 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:12:42.966123 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:12:42.971830 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jan 26 19:12:42.972188 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1130551473, sha256file filename: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:12:43.052578 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:12:43.052578 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1130551473, metadata filename: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:12:43.089270 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "77a1d870-40f5-4ca3-ac11-2d7fe6afc487",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1451819015",\n "created_at": "2026-01-27 00:12:25+00:00",\n "objects": [\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "b6214f03-b8e1-4484-94a1-ccba3b65c5d9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"b6214f03-b8e1-4484-94a1-ccba3b65c5d9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:12:23.000000\\", \\"launched_at\\": \\"2026-01-27T00:12:25.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-178073742\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 0\\", \\"provider_auth\\": \\"CHAP hopBLzfWFt2XeYRxKCso kxVjaFZyFh4bVS9D\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:12:23.000000\\", \\"updated_at\\": \\"2026-01-27T00:12:28.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"os_glance_failed_import\\": \\"\\", \\"image_id\\": \\"83e5abfe-72a8-4364-96d1-e39a77cf888f\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:12:43.093972 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] backup 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:12:43.195960 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:43.216686 np0005596550.novalocal sudo[230032]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:12:43.566032 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.370s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:43.569312 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'target_lun': 0, 'volume_id': 'b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 'auth_method': 'CHAP', 'auth_username': 'hopBLzfWFt2XeYRxKCso', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405e3b0f39c504b4f5998fd9cad7', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:43.569508 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:44.829145 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.260s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:44.830263 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.837921 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.838153 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[29af1fef-3089-4639-bbdc-c8d59fd82936]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:12:44.838450 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:44.839024 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:12:44.839024 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:12:44.839024 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:12:44.839024 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:12:44.840798 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.849930 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.849930 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6fc68b-5892-421a-818a-ee3502cbe927]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.850735 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.863283 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.863413 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f311e53-991c-4a3d-a864-a3381ae64f74]: (4, ('tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash)\ntcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.863710 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:44.863710 np0005596550.novalocal cinder-backup[194750]: tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:44.863710 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:44.863991 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [17] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 (non-flash) Jan 26 19:12:44.863991 np0005596550.novalocal cinder-backup[194750]: tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:44.863991 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:44.864378 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23c8ae0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:12:44.864626 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:12:44.865495 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.870320 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[101372c8-6c8d-4582-8eb3-04e8bc94530a]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:44.872617 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:44.874994 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[101372c8-6c8d-4582-8eb3-04e8bc94530a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.875558 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:12:44.876331 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.881070 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.881232 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d052baa-f327-4bab-b9cf-711b59a98059]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.881505 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:12:44.882383 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.933801 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.051s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.934224 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad90791-b54c-40a9-a674-fa8be6dbc9d4]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.934788 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:12:44.935143 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:12:44.935687 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:12:44.938148 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.948662 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.948981 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a0a0e-8fbf-498a-b066-43269296ad8d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.949570 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:44.951023 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.980860 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --logout" returned: 0 in 0.029s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.981120 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e96ad2-22d5-4f67-ad7d-d545ab8574bd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.981604 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260] Jan 26 19:12:44.981604 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9, portal: 38.102.83.18,3260] successful. Jan 26 19:12:44.981604 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:44.982815 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:44.992119 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:44.992300 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d438aa46-6665-4f14-8f14-1575d8751018]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:44.992654 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:44.993053 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.164s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:44.993271 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (1423ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:48.525215 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b464c967-a929-4212-9d20-f0281db45d59 tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487. Jan 26 19:12:50.855737 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Restore backup started, backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. Jan 26 19:12:50.864986 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:12:50.865144 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:12:50.865427 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:50.866298 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:50.872861 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:50.873962 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2674f8-badf-4d30-bed0-7ea3e68428ac]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7fa435be-3b5a-4dbc-ba24-de8b8ad0179c]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:50.875971 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:12:50.879430 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa435be-3b5a-4dbc-ba24-de8b8ad0179c]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:50.879965 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:12:50.880295 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:12:50.881186 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:50.894514 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:50.894725 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9460d44-8f3c-401f-83de-6f534d7ed550]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:50.896980 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:50.906574 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:50.906885 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256b522-88cc-4403-9b1a-1a30551edc5a]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:50.907638 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ade35-73a7-443d-8c39-f2244e237002]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:50.907964 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:50.919376 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:50.919655 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:12:50.921437 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:12:50.922197 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf', 'fe80::fc16:3eff:fe51:2969', 'fe80::80b1:6eff:fe3b:3770'] Jan 26 19:12:50.922449 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:12:50.922591 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:12:50.923006 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe64:d95d', 'fe80::50b2:68ff:fe0c:fabf', 'fe80::fc16:3eff:fe51:2969', 'fe80::80b1:6eff:fe3b:3770']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:56.442855 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:12:56.444091 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'target_lun': 0, 'volume_id': '85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'auth_method': 'CHAP', 'auth_username': 'vJGcUi8JeTGpQxkyVJ8A', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:12:56.444438 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:56.446744 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:56.447112 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'target_lun': 0, 'volume_id': '85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'auth_method': 'CHAP', 'auth_username': 'vJGcUi8JeTGpQxkyVJ8A', 'auth_password': '7zjCSFK34z8cTFsi', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:12:56.451308 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:56.454659 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d3382f4a-bf6c-4683-a096-7b52d60d2fe6]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:12:56.457359 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:12:56.458953 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3382f4a-bf6c-4683-a096-7b52d60d2fe6]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:56.459524 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:12:56.460004 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:12:56.460254 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:56.461935 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:56.468519 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260" returned: 21 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:56.468637 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fca18a-bc5f-421e-99b8-dfbc17d961e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:56.468930 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:12:56.468930 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:56.469533 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:56.477815 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:56.478095 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7393b3-8994-4fb4-a9be-7a9e94660915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:56.478445 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e] added Jan 26 19:12:56.478445 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:12:56.478445 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:56.478445 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:12:56.478445 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:56.478594 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:12:56.479135 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.019(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:12:56.479375 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:12:57.480475 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:12:57.481279 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.488190 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.488351 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0c3383-5c2f-49bc-88ca-f93796595164]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:12:57.489200 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.493482 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.509519 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.509749 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[01312774-a771-4102-bf05-a0ef2243987c]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.511361 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.512690 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.520646 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.520967 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e9e1a-7c27-4582-9e57-ab83c6e8fee7]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.521521 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.523809 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vJGcUi8JeTGpQxkyVJ8A {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.536431 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.username -v vJGcUi8JeTGpQxkyVJ8A" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.536642 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0267fb7-edf2-40f3-ad35-0c7090fd65ac]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.537088 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJGcUi8JeTGpQxkyVJ8A'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.538422 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.548093 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.548286 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bbc934-7691-4473-904d-d2e6718964d1]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.548774 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.549814 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[833a44b6-e52a-4d18-be15-ff80cf04d52f]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:57.562216 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:57.563077 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.582629 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.582629 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b050c7c8-b595-44fc-b8ce-590256c17bc5]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.582629 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260] successful. Jan 26 19:12:57.582629 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.583805 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.595297 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.595556 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f88c0-fb06-4179-a733-48b56c125f13]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.595948 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:12:57.596916 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[178c6fc0-c23d-404c-866c-710873a5c745]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\ntcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] HCTL ('2', '-', '-', 0) found on session 19 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:12:57.609996 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:12:57.610572 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:57.630818 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.020s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:57.630975 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc45550-6851-4ff6-ad21-041f1733e8d4]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:12:57.631559 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 19 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:58.635791 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 19 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:12:58.635791 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'target_lun': 0, 'volume_id': '85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'auth_method': 'CHAP', 'auth_username': 'vJGcUi8JeTGpQxkyVJ8A', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:12:58.635791 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.189s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:12:58.635791 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2189ms) {'type': 'block', 'scsi_wwn': '36001405bc4fcca204994e6390fde39d5', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:12:58.635791 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:12:58.656245 np0005596550.novalocal sudo[230497]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:12:59.009566 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.373s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:12:59.009566 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] starting restore of backup volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487 container: tempest-volumesbackupstest-backup-container-1130551473, to new volume 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487. {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:783}} Jan 26 19:12:59.009566 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1130551473, metadata filename: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] _read_metadata finished. Metadata: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "backup_description": null, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "backup_id": "77a1d870-40f5-4ca3-ac11-2d7fe6afc487", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "backup_name": "tempest-VolumesBackupsTest-Backup-1451819015", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "created_at": "2026-01-27 00:12:25+00:00", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "objects": [ Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "82571f7121cb9475563edde615e4e4df", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 0 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 52428800 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "a35891500449df17e893f84bd88472fb", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 104857600 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 157286400 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 209715200 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 262144000 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 314572800 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 367001600 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 419430400 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 471859200 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 524288000 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 576716800 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 629145600 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 681574400 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 734003200 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 786432000 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 838860800 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 891289600 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 943718400 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 996147200 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021": { Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "length": 25165824, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "offset": 1048576000 Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: ], Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "parent_id": null, Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "version": "1.0.0", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_id": "b6214f03-b8e1-4484-94a1-ccba3b65c5d9", Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b6214f03-b8e1-4484-94a1-ccba3b65c5d9\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e6cbe3740f6c4303bbf3e5d5c92677db\", \"project_id\": \"261cb1c98c954302ba86efa2ceee43f2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-27T00:12:23.000000\", \"launched_at\": \"2026-01-27T00:12:25.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-178073742\", \"display_description\": null, \"provider_location\": \"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 0\", \"provider_auth\": \"CHAP hopBLzfWFt2XeYRxKCso kxVjaFZyFh4bVS9D\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"423298ae-9268-4d03-9cb5-063c9922a67c\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-27T00:12:23.000000\", \"updated_at\": \"2026-01-27T00:12:28.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.sha256\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"os_glance_importing_to_stores\": \"\", \"os_glance_failed_import\": \"\", \"image_id\": \"83e5abfe-72a8-4364-96d1-e39a77cf888f\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: }. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Restoring backup version 1.0.0 {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:796}} Jan 26 19:12:59.064455 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1130551473, metadata filename: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] _read_metadata finished. Metadata: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "backup_description": null, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "backup_id": "77a1d870-40f5-4ca3-ac11-2d7fe6afc487", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "backup_name": "tempest-VolumesBackupsTest-Backup-1451819015", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "created_at": "2026-01-27 00:12:25+00:00", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "objects": [ Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "82571f7121cb9475563edde615e4e4df", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 0 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 52428800 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "a35891500449df17e893f84bd88472fb", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 104857600 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 157286400 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 209715200 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 262144000 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 314572800 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 367001600 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 419430400 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 471859200 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 524288000 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 576716800 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 629145600 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 681574400 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 734003200 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 786432000 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 838860800 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 891289600 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 943718400 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 996147200 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021": { Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "length": 25165824, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "offset": 1048576000 Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: ], Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "parent_id": null, Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "version": "1.0.0", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_id": "b6214f03-b8e1-4484-94a1-ccba3b65c5d9", Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"b6214f03-b8e1-4484-94a1-ccba3b65c5d9\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e6cbe3740f6c4303bbf3e5d5c92677db\", \"project_id\": \"261cb1c98c954302ba86efa2ceee43f2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-27T00:12:23.000000\", \"launched_at\": \"2026-01-27T00:12:25.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-178073742\", \"display_description\": null, \"provider_location\": \"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 iqn.2010-10.org.openstack:volume-b6214f03-b8e1-4484-94a1-ccba3b65c5d9 0\", \"provider_auth\": \"CHAP hopBLzfWFt2XeYRxKCso kxVjaFZyFh4bVS9D\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"423298ae-9268-4d03-9cb5-063c9922a67c\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-27T00:12:23.000000\", \"updated_at\": \"2026-01-27T00:12:28.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.sha256\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"os_glance_importing_to_stores\": \"\", \"os_glance_failed_import\": \"\", \"image_id\": \"83e5abfe-72a8-4364-96d1-e39a77cf888f\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: }. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] v1 volume backup restore of 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 started. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:700}} Jan 26 19:12:59.090885 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] metadata_object_names = ['volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021']. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:707}} Jan 26 19:12:59.178575 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:12:59.183588 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:12:59.187618 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:12:59.258403 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:12:59.865308 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:12:59.883155 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:00.110679 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:00.133570 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:00.368591 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:00.386996 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:00.585982 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:00.602444 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:00.800971 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:00.817686 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:01.012375 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:01.026359 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:01.217274 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:01.235314 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:01.458175 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:01.469556 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:01.664602 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:01.679105 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:01.874781 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:01.888328 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:02.075727 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:02.095320 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:02.289602 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:02.310307 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:02.531752 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:02.548910 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:02.748453 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:02.767254 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:03.843951 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:03.871296 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:04.095264 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:04.113362 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:04.306028 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:04.322117 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:04.534669 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:04.551548 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:04.736596 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:04.753010 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:04.958387 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, object name: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021, volume: 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:04.980284 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:05.070607 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] v1 volume backup restore of 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 finished. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:772}} Jan 26 19:13:05.070817 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Restoring volume base metadata {{(pid=194750) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jan 26 19:13:05.092056 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] No metadata of type 'volume-metadata' to restore {{(pid=194750) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jan 26 19:13:05.092056 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Restoring volume glance metadata {{(pid=194750) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jan 26 19:13:05.202847 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] restore 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 to 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e finished. {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:837}} Jan 26 19:13:05.205240 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.246088 np0005596550.novalocal sudo[230555]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:13:05.638376 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.433s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.639508 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'target_lun': 0, 'volume_id': '85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 'auth_method': 'CHAP', 'auth_username': 'vJGcUi8JeTGpQxkyVJ8A', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405bc4fcca204994e6390fde39d5', 'path': '/dev/sda'}), 'kwargs': {'force': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:05.639920 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:05.640543 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:05.642336 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.652243 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.652567 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[98272940-f643-47a0-bf2d-2e32f6b44bf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:05.653192 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:05.653668 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:13:05.653668 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:13:05.653668 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:13:05.654119 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:13:05.655261 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.665435 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.665703 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac4c6ff-d592-4ea6-9397-416d24d97fdd]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.666957 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.674822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.674822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2216bfa-b47b-440d-a550-339cfb949156]: (4, ('tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash)\ntcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash)\ntcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [18] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9269157b-43f4-432c-b270-58069bb4a632 (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: tcp: [19] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: tcp: [20] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-9b5f535f-532a-41aa-84ad-d1d38c3cf3b6 (non-flash) Jan 26 19:13:05.675531 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:05.676319 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23f4b80>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:13:05.676385 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:13:05.677161 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.681904 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ba11968f-d4e5-4f56-ae91-bbc16c7affe2]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:05.684295 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:05.686277 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba11968f-d4e5-4f56-ae91-bbc16c7affe2]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.686734 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:13:05.687584 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.692662 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.692820 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[065b7a85-2296-4c3f-95b2-0a08b6d21ade]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.693177 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:13:05.694094 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.744807 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.048s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.744807 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1104f1db-b4a8-4dcb-895c-81c1fc898fa2]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.744807 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:13:05.744807 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:13:05.744807 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:13:05.746314 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.757849 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.758467 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[95449e70-a27a-4644-a4f0-75317dd3a562]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.758843 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:05.759685 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.796004 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --logout" returned: 0 in 0.035s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.796422 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e10231-62a8-4781-91ce-e8a1a385129a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.797246 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260] Jan 26 19:13:05.797246 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e, portal: 38.102.83.18,3260] successful. Jan 26 19:13:05.797246 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:05.798646 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:05.808489 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-85fc237e-7f42-477d-8d44-9c2a3cd8bc4e -p 38.102.83.18:3260 --op delete" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:05.808870 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353518d-2aca-49af-8355-9a33c47f8de5]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:05.809318 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:05.809911 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.169s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:05.810256 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (170ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:11.841181 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.manager [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Encryption key ID for volume 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e already matches encryption key ID in backup 77a1d870-40f5-4ca3-ac11-2d7fe6afc487. {{(pid=194750) _run_restore /opt/stack/cinder/cinder/backup/manager.py:874}} Jan 26 19:13:11.891213 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-1603d660-b61a-4e97-8563-01a848ba3381 tempest-VolumesBackupsTest-97611117 None] Finished restoring backup 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 to volume 85fc237e-7f42-477d-8d44-9c2a3cd8bc4e. Jan 26 19:13:14.736379 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487. Jan 26 19:13:14.738285 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:13:14.738558 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:13:14.739051 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] delete started, backup: 77a1d870-40f5-4ca3-ac11-2d7fe6afc487, container: tempest-volumesbackupstest-backup-container-1130551473, prefix: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:13:14.783939 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata', 'volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:13:14.826962 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00001 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:14.852231 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00002 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:14.902730 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00003 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:14.942584 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00004 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:14.969909 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00005 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.004897 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00006 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.033176 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00007 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.072454 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00008 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.106862 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00009 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.153821 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00010 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.181088 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00011 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.212390 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00012 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.296582 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00013 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.364146 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00014 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.437963 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00015 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.539214 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00016 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.624502 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00017 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.716553 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00018 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.794867 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00019 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.833213 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00020 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.866808 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487-00021 in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.933967 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_metadata in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.972394 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_b6214f03-b8e1-4484-94a1-ccba3b65c5d9/20260127001232/az_nova_backup_77a1d870-40f5-4ca3-ac11-2d7fe6afc487_sha256file in container: tempest-volumesbackupstest-backup-container-1130551473. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:13:15.972625 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] delete 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:13:15.975314 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:13:15.994149 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] Created reservations ['c0f3ce8b-a4e0-47ac-b0ea-3f9844d74ff4', 'b49cbc34-86dc-43a1-a2b7-31bc12609304'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:13:16.029017 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-21e1efb4-ed4e-4236-bca2-3bafee4200a8 tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup 77a1d870-40f5-4ca3-ac11-2d7fe6afc487 deleted. Jan 26 19:13:21.703081 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=96,cinder:UPDATE=17,cinder:INSERT=17 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:13:21.709663 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: 1375deb5-7a56-409b-b156-f58095d6bcea volume: 61464ad9-5ea0-4139-ab0d-1a6e8c1a1434. Jan 26 19:13:21.717593 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1182261828',created_at=2026-01-27T00:13:21Z,data_timestamp=2026-01-27T00:13:21Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-927080037',display_name='tempest-VolumesBackupsTest-Backup-1141423123',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=1375deb5-7a56-409b-b156-f58095d6bcea,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=61464ad9-5ea0-4139-ab0d-1a6e8c1a1434) Jan 26 19:13:21.749860 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:13:21.750003 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:13:21.750654 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:21.755617 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:21.763866 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:21.764040 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb146abd-fb4a-47d5-b4a3-fb506c250c19]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[369163b3-aa06-4c13-ab9a-fd1cdede6cd6]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:21.766327 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:13:21.766651 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[369163b3-aa06-4c13-ab9a-fd1cdede6cd6]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:21.767107 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:13:21.767357 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:13:21.768987 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:21.782384 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:21.782614 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c1ea9-c256-466d-b19f-c1544c4f1154]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:21.784314 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:21.796710 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:21.796909 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[04592353-1404-4f8f-8b82-d17dd22155c9]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:21.798194 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[956171fe-de37-4b45-a9ca-def420343e72]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:21.798655 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:21.812118 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:21.812393 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:13:21.814642 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:13:21.815325 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe51:2969', 'fe80::417:c0ff:fe2b:cc97'] Jan 26 19:13:21.815461 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:13:21.815585 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:13:21.815872 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:fe51:2969', 'fe80::417:c0ff:fe2b:cc97']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:23.769138 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:13:23.769337 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:13:25.827509 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:13:25.829758 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'target_lun': 0, 'volume_id': '61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'auth_method': 'CHAP', 'auth_username': 'pL8c98e7AjL9rQ3NY6Ta', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:25.829758 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:25.829758 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:25.829758 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'target_lun': 0, 'volume_id': '61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'auth_method': 'CHAP', 'auth_username': 'pL8c98e7AjL9rQ3NY6Ta', 'auth_password': 'q49TxST9atMmJGDK', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:13:25.830530 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:25.840238 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[bfe7b032-eceb-414f-8e99-06a2d9b04b23]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:25.840820 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:25.841999 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7b032-eceb-414f-8e99-06a2d9b04b23]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:25.842575 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:25.843043 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:25.843267 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:13:25.849685 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:25.855051 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:25.857330 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b4266-540d-41c0-a6c1-8db935ea2737]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:25.858315 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:13:25.858315 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:25.859885 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:25.869472 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:25.869880 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a8e74-975a-4b43-94aa-c203219af02f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434] added Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:25.873121 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:13:25.873939 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:13:25.874448 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:13:26.876433 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:13:26.879633 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.891279 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.891466 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef626db4-ab29-4759-9efa-ca1369c74048]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:13:26.893458 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.894745 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.907889 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.908065 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b68c6a-81c6-4e0c-ba29-693485afbdaf]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.908486 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.909462 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.921002 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.921199 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc91ad65-288b-4ca8-90b8-92ce5ade06c8]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.921654 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.922686 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v pL8c98e7AjL9rQ3NY6Ta {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.935038 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v pL8c98e7AjL9rQ3NY6Ta" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.935226 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3444e24-b849-445b-9b5f-472e989f9f81]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.935606 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pL8c98e7AjL9rQ3NY6Ta'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.936585 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.948957 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.949127 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[550cdbab-10b3-4e36-b993-b728eb0565e8]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.949594 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.950418 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.963412 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.963592 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b65987-04e4-4626-84ac-fe48478c13b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.964057 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:13:26.964057 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:26.964189 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:13:26.964189 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:26.964319 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:13:26.964319 np0005596550.novalocal cinder-backup[194750]: Jan 26 19:13:26.965211 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.983137 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --login" returned: 0 in 0.017s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.983331 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced5a05-0dcf-4bd9-8aa0-5a342ff4ec61]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.983711 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260] successful. Jan 26 19:13:26.983711 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:26.984847 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:26.998329 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:26.998608 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7a7a9-9216-4deb-b6cd-0bb3f99737ae]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:26.998944 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:27.000889 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:27.013242 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:27.013993 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ce0ad9-c389-4ac9-aa6b-e1b9dca1d815]: (4, ('tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:27.013993 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash) Jan 26 19:13:27.013993 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:27.013993 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash) Jan 26 19:13:27.013993 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:27.014302 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:27.014468 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:13:27.014937 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] HCTL ('2', '-', '-', 0) found on session 21 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:13:27.015086 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:13:27.015998 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:27.041891 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.025s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:27.042055 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[22320837-c61b-4cb2-b133-884f1d8cca21]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:27.044805 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 21 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:13:28.046792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 21 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:13:28.046792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'target_lun': 0, 'volume_id': '61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'auth_method': 'CHAP', 'auth_username': 'pL8c98e7AjL9rQ3NY6Ta', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:13:28.046792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.217s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:28.046792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2217ms) {'type': 'block', 'scsi_wwn': '36001405114849bbf0ed45ee9366c6765', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:28.046792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:28.068714 np0005596550.novalocal sudo[231246]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:13:28.504924 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.457s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:28.508678 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:13:28.518483 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1182261828,backup: 1375deb5-7a56-409b-b156-f58095d6bcea. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:13:28.658929 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:13:28.667985 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] starting backup of volume: 61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, volume size: 1073741824, object names prefix volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:13:28.818021 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:28.972154 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:28.972351 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:29.150183 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:29.150563 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:29.287489 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:29.409635 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:29.409749 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:29.524791 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:29.524998 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:29.671093 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:29.821733 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:29.821733 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:29.943323 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:29.945032 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:30.073094 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:30.220596 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:30.220919 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:30.350950 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:30.351133 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:30.501491 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:30.635375 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:30.635375 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:30.747843 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:30.747843 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:30.894231 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:31.031456 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:31.031730 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:31.149880 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:31.149880 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:31.463356 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:31.607135 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:31.607135 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:31.747900 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:31.747900 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:31.908685 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:32.040401 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:32.040535 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:32.162570 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:32.162923 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:32.291660 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:32.401987 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:32.402181 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:32.521036 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:32.521453 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:32.862298 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:32.995986 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:32.996224 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:33.112574 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:33.112690 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:33.461750 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:33.591442 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:33.592060 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:33.734994 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:33.735138 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:33.848041 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:33.992321 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:33.992321 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:34.132264 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:34.132478 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:34.506162 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:34.644059 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:34.644479 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:34.767429 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:34.767977 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:34.913745 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:35.055811 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:35.055962 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:35.195149 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:35.195341 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:35.375467 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:35.500797 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:35.500953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:35.613278 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:35.613498 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:35.780322 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:35.929159 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:35.929521 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:36.069227 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:36.069369 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:36.188083 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:36.319564 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:36.319683 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:36.468219 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:36.468219 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:36.636997 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:36.750317 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:36.750449 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:36.879414 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:36.879861 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:37.241859 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:37.353451 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:37.353634 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:37.461200 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:37.461383 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:37.613742 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:37.728689 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:37.728849 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:37.877540 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:37.877725 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:38.072064 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:13:38.134976 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:13:38.135143 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:13:38.206258 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:13:38.206875 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:13:38.214488 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:13:38.224313 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:13:38.224605 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:13:38.229892 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jan 26 19:13:38.230209 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:13:38.233417 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:13:38.233850 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1182261828, sha256file filename: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:13:38.295872 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:13:38.295872 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1182261828, metadata filename: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:13:38.327619 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-927080037",\n "backup_id": "1375deb5-7a56-409b-b156-f58095d6bcea",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1141423123",\n "created_at": "2026-01-27 00:13:21+00:00",\n "objects": [\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "61464ad9-5ea0-4139-ab0d-1a6e8c1a1434",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:13:20.000000\\", \\"launched_at\\": \\"2026-01-27T00:13:21.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2123577346\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 0\\", \\"provider_auth\\": \\"CHAP pL8c98e7AjL9rQ3NY6Ta q49TxST9atMmJGDK\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:13:20.000000\\", \\"updated_at\\": \\"2026-01-27T00:13:24.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:13:38.331001 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] backup 1375deb5-7a56-409b-b156-f58095d6bcea finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:13:38.421621 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.441700 np0005596550.novalocal sudo[231458]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:13:38.799580 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.377s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.801056 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'target_lun': 0, 'volume_id': '61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 'auth_method': 'CHAP', 'auth_username': 'pL8c98e7AjL9rQ3NY6Ta', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405114849bbf0ed45ee9366c6765', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:38.801311 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:38.802030 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:38.804153 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.812070 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.812221 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[889a5a54-5e71-4660-9a94-e3f353172bf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:38.812495 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:38.812688 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:13:38.812688 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:13:38.812688 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:13:38.812943 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:13:38.813741 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.821163 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.821321 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4feb283-5adc-4066-9b57-42aef92962fc]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.822057 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.829951 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.830068 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc56a8c-e720-4665-8d9b-68e961386d44]: (4, ('tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.830347 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash) Jan 26 19:13:38.830347 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:38.830476 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [21] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 (non-flash) Jan 26 19:13:38.830476 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:38.831034 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad24287c0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:13:38.831224 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:13:38.831984 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.839169 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3bf7e395-a273-4d86-bf13-5f73ac72df09]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:38.840953 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:38.842215 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7e395-a273-4d86-bf13-5f73ac72df09]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.842829 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:13:38.843720 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.848981 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.849133 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d99d45-6893-452f-ad2e-3bd62436d352]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.849454 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:13:38.850343 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.900517 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.050s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.900701 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d10ed6-2681-4670-a834-10cce548315b]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.901098 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:13:38.901293 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:13:38.901508 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:13:38.902246 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.908965 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.909089 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ab4bc-b413-4b56-9f41-059465a1971a]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.909414 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:38.910156 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.937609 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --logout" returned: 0 in 0.027s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.938262 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91efc3-a982-4512-8b80-2c7d8fc149de]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.938602 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260] Jan 26 19:13:38.938602 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434, portal: 38.102.83.18,3260] successful. Jan 26 19:13:38.938602 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:38.939595 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:38.947704 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:38.948156 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[964fb128-fca5-45db-a7a7-1517d773f623]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:38.948785 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:38.949090 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.147s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:38.949398 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (148ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:42.504188 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4abce085-5ed6-4a9f-9a49-852a51a639f6 tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: 1375deb5-7a56-409b-b156-f58095d6bcea. Jan 26 19:13:44.686237 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Restore backup started, backup: 1375deb5-7a56-409b-b156-f58095d6bcea volume: f522b465-c847-44e5-8386-0f9f12b27d2a. Jan 26 19:13:44.699202 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:13:44.699435 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:13:44.699877 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:44.702192 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:44.715086 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:44.715250 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2c313-877a-462f-acba-a1c54fe15df9]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a6070939-a96c-4e1d-ae6b-2463eac54b4e]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6070939-a96c-4e1d-ae6b-2463eac54b4e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:13:44.719021 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:13:44.719812 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:44.731476 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:44.732409 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddf7c9-8a34-405d-b167-1fbc519128fc]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:44.733573 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:44.746753 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:44.746942 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970fb2d-4dca-4392-b454-7317f937c1c0]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:44.748319 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5095eec3-6888-43bf-9e9e-9c818d3aa6eb]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:44.748788 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:44.762742 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:44.762742 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:13:44.766061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:13:44.766061 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48'] Jan 26 19:13:44.766061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:13:44.766061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:13:44.766061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:48.779888 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:13:48.779888 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a', 'target_lun': 0, 'volume_id': 'f522b465-c847-44e5-8386-0f9f12b27d2a', 'auth_method': 'CHAP', 'auth_username': 'kntA6aG3CW6w5N82tvLV', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:48.779888 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:48.779888 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:48.779888 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a', 'target_lun': 0, 'volume_id': 'f522b465-c847-44e5-8386-0f9f12b27d2a', 'auth_method': 'CHAP', 'auth_username': 'kntA6aG3CW6w5N82tvLV', 'auth_password': 'R4voJQrG5VNF6kL2', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:13:48.781465 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:48.791581 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7ddf62cb-9136-43dc-982e-fe5cd9f0ad4b]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:48.794023 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:48.795690 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf62cb-9136-43dc-982e-fe5cd9f0ad4b]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:48.796230 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:48.796674 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:48.796873 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:13:48.797924 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:48.810582 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260" returned: 21 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:48.811071 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a50a8f-b70e-4655-9b2e-bd9314e8a525]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:48.811367 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:13:48.811367 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:48.812168 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:48.822574 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:48.822604 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906a38a-484e-4e6c-89df-32163127579a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:48.822946 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a] added Jan 26 19:13:48.822946 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:13:48.822946 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:13:48.822946 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:13:48.822946 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:48.823082 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:13:48.823461 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:13:48.823664 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:13:49.824522 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:13:49.826339 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.835080 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.835836 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56699b2-e0e0-42c5-a3ef-34447bab50ef]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:13:49.836466 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.838263 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.848382 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.848589 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dfe6e5-2b05-48e4-84d9-b6945c18499e]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.849044 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.849823 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.859647 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.859647 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b48b0f-3243-421e-b1c7-9ff0ad162755]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.859933 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.860635 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v kntA6aG3CW6w5N82tvLV {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.870726 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.username -v kntA6aG3CW6w5N82tvLV" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.870913 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9a4d6-e290-46f6-9ac2-73c96fec2800]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.871288 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kntA6aG3CW6w5N82tvLV'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.873421 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.881148 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.881358 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300a369-9a04-4527-bf28-b472bab1078a]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.881657 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.882507 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.892323 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.892452 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2e2b3-cc88-4bcd-ae9e-b2a0e96aa3b5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.892837 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:13:49.892837 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:49.893007 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:13:49.893007 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:49.893175 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:13:49.893175 np0005596550.novalocal cinder-backup[194750]: Jan 26 19:13:49.893877 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.907241 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --login" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.907349 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1ab8bf-1e01-49ba-950e-95cb9d1e23e8]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.907652 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260] successful. Jan 26 19:13:49.907652 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.909432 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.920503 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.920633 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97366e3-a2d4-4968-99a1-488140968983]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.921158 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:49.921714 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.929337 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.929550 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91319a4-77a9-455f-a74f-2f815d3393eb]: (4, ('tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.930066 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash) Jan 26 19:13:49.930066 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:49.930226 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash) Jan 26 19:13:49.930226 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:49.930530 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:49.930689 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:13:49.931112 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] HCTL ('2', '-', '-', 0) found on session 22 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:13:49.931267 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:13:49.932314 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:49.948986 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.015s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:49.949142 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f64db8c-fcd2-4fad-a8f9-86d48a2aac58]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:49.949615 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 22 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:13:50.951362 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 22 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:13:50.951362 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a', 'target_lun': 0, 'volume_id': 'f522b465-c847-44e5-8386-0f9f12b27d2a', 'auth_method': 'CHAP', 'auth_username': 'kntA6aG3CW6w5N82tvLV', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:13:50.951991 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.172s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:50.952124 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2173ms) {'type': 'block', 'scsi_wwn': '3600140585c8281f96e84ed680c19ae82', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:13:50.952477 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:50.974706 np0005596550.novalocal sudo[231645]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:13:51.412196 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.459s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:51.412646 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] starting restore of backup volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea container: tempest-volumesbackupstest-backup-container-1182261828, to new volume f522b465-c847-44e5-8386-0f9f12b27d2a, backup: 1375deb5-7a56-409b-b156-f58095d6bcea. {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:783}} Jan 26 19:13:51.414786 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1182261828, metadata filename: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] _read_metadata finished. Metadata: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "backup_description": "tempest-backup-description-927080037", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "backup_id": "1375deb5-7a56-409b-b156-f58095d6bcea", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "backup_name": "tempest-VolumesBackupsTest-Backup-1141423123", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "created_at": "2026-01-27 00:13:21+00:00", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "objects": [ Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 0 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 52428800 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 104857600 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 157286400 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 209715200 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 262144000 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 314572800 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 367001600 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 419430400 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 471859200 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 524288000 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 576716800 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 629145600 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 681574400 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 734003200 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 786432000 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 838860800 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 891289600 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 943718400 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 996147200 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021": { Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "length": 25165824, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "offset": 1048576000 Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: ], Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "parent_id": null, Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "version": "1.0.0", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_id": "61464ad9-5ea0-4139-ab0d-1a6e8c1a1434", Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e6cbe3740f6c4303bbf3e5d5c92677db\", \"project_id\": \"261cb1c98c954302ba86efa2ceee43f2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-27T00:13:20.000000\", \"launched_at\": \"2026-01-27T00:13:21.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2123577346\", \"display_description\": null, \"provider_location\": \"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 0\", \"provider_auth\": \"CHAP pL8c98e7AjL9rQ3NY6Ta q49TxST9atMmJGDK\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"423298ae-9268-4d03-9cb5-063c9922a67c\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-27T00:13:20.000000\", \"updated_at\": \"2026-01-27T00:13:24.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jan 26 19:13:51.443638 np0005596550.novalocal cinder-backup[194750]: }. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 26 19:13:51.445875 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Restoring backup version 1.0.0 {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:796}} Jan 26 19:13:51.445875 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1182261828, metadata filename: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] _read_metadata finished. Metadata: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "backup_description": "tempest-backup-description-927080037", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "backup_id": "1375deb5-7a56-409b-b156-f58095d6bcea", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "backup_name": "tempest-VolumesBackupsTest-Backup-1141423123", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "created_at": "2026-01-27 00:13:21+00:00", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "objects": [ Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 0 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 52428800 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 104857600 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 157286400 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 209715200 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 262144000 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 314572800 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 367001600 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 419430400 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 471859200 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 524288000 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 576716800 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 629145600 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 681574400 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 734003200 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 786432000 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 838860800 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 891289600 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 943718400 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 52428800, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 996147200 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021": { Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "compression": "zlib", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "length": 25165824, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "offset": 1048576000 Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: } Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: ], Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "parent_id": null, Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "version": "1.0.0", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_id": "61464ad9-5ea0-4139-ab0d-1a6e8c1a1434", Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"61464ad9-5ea0-4139-ab0d-1a6e8c1a1434\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"e6cbe3740f6c4303bbf3e5d5c92677db\", \"project_id\": \"261cb1c98c954302ba86efa2ceee43f2\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-27T00:13:20.000000\", \"launched_at\": \"2026-01-27T00:13:21.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-2123577346\", \"display_description\": null, \"provider_location\": \"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 iqn.2010-10.org.openstack:volume-61464ad9-5ea0-4139-ab0d-1a6e8c1a1434 0\", \"provider_auth\": \"CHAP pL8c98e7AjL9rQ3NY6Ta q49TxST9atMmJGDK\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"423298ae-9268-4d03-9cb5-063c9922a67c\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-27T00:13:20.000000\", \"updated_at\": \"2026-01-27T00:13:24.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jan 26 19:13:51.467036 np0005596550.novalocal cinder-backup[194750]: }. {{(pid=194750) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 26 19:13:51.470079 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] v1 volume backup restore of 1375deb5-7a56-409b-b156-f58095d6bcea started. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:700}} Jan 26 19:13:51.470079 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] metadata_object_names = ['volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021']. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:707}} Jan 26 19:13:51.526425 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:13:51.530106 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:13:51.537047 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:51.553209 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:51.793507 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:51.819521 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:52.078694 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:52.095904 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:52.302529 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:52.317432 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:52.539956 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:52.558960 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:52.781800 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:52.797015 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:53.004226 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:53.020177 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:53.233090 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:53.248647 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:53.454159 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:53.468270 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:53.696476 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:53.710476 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:53.916951 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:53.933223 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:54.147131 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:54.164382 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:54.388020 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:54.405536 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:54.611926 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:54.633017 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:54.850384 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:54.868753 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:55.087360 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:55.103306 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:55.330860 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:55.345715 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:55.553424 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:55.570314 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:55.783396 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:55.802190 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:56.046246 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:56.061629 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:56.260695 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restoring object. backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, object name: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021, volume: f522b465-c847-44e5-8386-0f9f12b27d2a. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 26 19:13:56.276108 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] decompressing data using zlib algorithm {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 26 19:13:56.420594 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] v1 volume backup restore of 1375deb5-7a56-409b-b156-f58095d6bcea finished. {{(pid=194750) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:772}} Jan 26 19:13:56.420830 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Restoring volume base metadata {{(pid=194750) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jan 26 19:13:56.558288 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Restoring volume metadata {{(pid=194750) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jan 26 19:13:56.642302 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=194750) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jan 26 19:13:56.642446 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] restore 1375deb5-7a56-409b-b156-f58095d6bcea to f522b465-c847-44e5-8386-0f9f12b27d2a finished. {{(pid=194750) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:837}} Jan 26 19:13:56.643843 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:56.665362 np0005596550.novalocal sudo[231666]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:13:57.034350 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.391s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.035370 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a', 'target_lun': 0, 'volume_id': 'f522b465-c847-44e5-8386-0f9f12b27d2a', 'auth_method': 'CHAP', 'auth_username': 'kntA6aG3CW6w5N82tvLV', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3600140585c8281f96e84ed680c19ae82', 'path': '/dev/sda'}), 'kwargs': {'force': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:13:57.035646 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:13:57.036056 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:13:57.037065 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.047539 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.047857 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7946b35c-0c12-4990-8f1f-fb3556168fe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:13:57.048297 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:57.048465 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:13:57.048465 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:13:57.048465 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:13:57.048936 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:13:57.049847 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.063320 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.063473 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d320efa9-8084-40ae-a947-1354f45b0256]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.065172 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.080581 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.015s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.080764 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02125b-5383-40a0-b7cd-05d254a49f7b]: (4, ('tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.081116 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash) Jan 26 19:13:57.081116 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:13:57.081298 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [22] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a (non-flash) Jan 26 19:13:57.081298 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:13:57.081824 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23f4680>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:13:57.082051 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:13:57.082914 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.089222 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c5e07bf7-9e9b-42d9-9405-97e4c9719f12]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:13:57.090342 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:13:57.091345 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e07bf7-9e9b-42d9-9405-97e4c9719f12]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.091944 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:13:57.092583 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.097810 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.097993 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad4d49c-4cf7-4354-a964-86413482c67e]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.098300 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:13:57.099053 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.153094 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.053s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.153313 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148455f-82ae-4f85-9fdd-9c16bde42b87]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.153859 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:13:57.154067 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:13:57.154389 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:13:57.155502 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.167195 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.167363 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99c646-60ac-40b0-a312-f28450396f94]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.167872 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:57.169085 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.205806 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --logout" returned: 0 in 0.037s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.206056 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8125cf3-dbf3-40bd-a089-cb23062622ef]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.206531 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260] Jan 26 19:13:57.206531 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a, portal: 38.102.83.18,3260] successful. Jan 26 19:13:57.206531 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:57.207323 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:13:57.216548 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-f522b465-c847-44e5-8386-0f9f12b27d2a -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:13:57.216984 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c77f1-134c-497d-8bef-35ed51fb1003]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:13:57.217372 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:13:57.217674 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:13:57.217891 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (182ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:14:00.785997 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.manager [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Encryption key ID for volume f522b465-c847-44e5-8386-0f9f12b27d2a already matches encryption key ID in backup 1375deb5-7a56-409b-b156-f58095d6bcea. {{(pid=194750) _run_restore /opt/stack/cinder/cinder/backup/manager.py:874}} Jan 26 19:14:00.815588 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-5626268e-881e-4506-8eda-3078a2be55cd tempest-VolumesBackupsTest-97611117 None] Finished restoring backup 1375deb5-7a56-409b-b156-f58095d6bcea to volume f522b465-c847-44e5-8386-0f9f12b27d2a. Jan 26 19:14:03.448334 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: 1375deb5-7a56-409b-b156-f58095d6bcea. Jan 26 19:14:03.449147 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:14:03.449302 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:14:03.449462 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] delete started, backup: 1375deb5-7a56-409b-b156-f58095d6bcea, container: tempest-volumesbackupstest-backup-container-1182261828, prefix: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:14:03.514434 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata', 'volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:14:03.552908 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00001 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.577498 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00002 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.615105 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00003 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.641123 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00004 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.670948 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00005 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.698161 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00006 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.725946 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00007 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.752546 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00008 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.780651 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00009 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.805690 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00010 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.836076 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00011 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.863599 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00012 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.891712 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00013 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.915016 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00014 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.936660 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00015 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.968964 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00016 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:03.998380 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00017 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.032354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00018 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.075298 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00019 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.122219 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00020 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.172792 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea-00021 in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.222713 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_metadata in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.265120 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] deleted object: volume_61464ad9-5ea0-4139-ab0d-1a6e8c1a1434/20260127001328/az_nova_backup_1375deb5-7a56-409b-b156-f58095d6bcea_sha256file in container: tempest-volumesbackupstest-backup-container-1182261828. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:14:04.265120 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] delete 1375deb5-7a56-409b-b156-f58095d6bcea finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:14:04.270793 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:14:04.325044 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] Created reservations ['98be9efc-69ca-4afe-aa21-65541213731b', 'd762e266-21ef-4b12-8e9e-e7abf7333585'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:14:04.357391 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-d244b8bb-8d2e-4d0c-b1a5-e6ef2a8143cc tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup 1375deb5-7a56-409b-b156-f58095d6bcea deleted. Jan 26 19:14:14.356220 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:UPDATE=15,cinder:SELECT=67,cinder:INSERT=4 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:14:23.772376 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:14:23.772727 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:15:16.563490 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: 5a277df6-85f7-4858-8b96-0c9364da2aa9 volume: d438bc89-fce8-47ba-bf8f-fd79987670fc. Jan 26 19:15:16.568808 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-346343214',created_at=2026-01-27T00:15:16Z,data_timestamp=2026-01-27T00:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1101682290',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=5a277df6-85f7-4858-8b96-0c9364da2aa9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=d438bc89-fce8-47ba-bf8f-fd79987670fc) Jan 26 19:15:18.052682 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:15:18.053146 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:15:18.053225 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:18.054800 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:18.064261 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:18.064451 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7180dc-a75f-4190-a211-283f2c2327fc]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f4721d39-9172-4c6b-9620-e3bc70a995eb]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4721d39-9172-4c6b-9620-e3bc70a995eb]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:18.067789 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:15:18.068276 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:15:18.069078 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:18.080453 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:18.080608 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c46e2-5bc6-4323-9a6c-66e8600282ff]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:18.084311 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:18.097224 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:18.097397 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5ca853-ee12-45b5-bbdc-0fbbf5e05662]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:18.100105 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[46230dc5-9410-4a46-8137-770fbc001036]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:18.100695 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:18.117483 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:18.118786 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:15:18.120061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:15:18.121662 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::94c4:4cff:fed6:bcae'] Jan 26 19:15:18.122832 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:15:18.122832 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:15:18.122832 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::94c4:4cff:fed6:bcae']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:22.137465 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:15:22.139753 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f', 'target_lun': 0, 'volume_id': '6af402df-3843-4a4d-a056-815956f2c91f', 'auth_method': 'CHAP', 'auth_username': 'ULvb2sFUWX84P7c2wFUN', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:22.139753 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:22.140147 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:22.140350 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f', 'target_lun': 0, 'volume_id': '6af402df-3843-4a4d-a056-815956f2c91f', 'auth_method': 'CHAP', 'auth_username': 'ULvb2sFUWX84P7c2wFUN', 'auth_password': 'Jn74kqBPK5t6AQyx', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:15:22.143488 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.151192 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[373de47b-1661-4a76-a636-5543a729b6ab]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:15:22.151664 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:15:22.152498 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[373de47b-1661-4a76-a636-5543a729b6ab]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:22.153313 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:22.153895 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:22.154158 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:22.162305 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.170307 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260" returned: 21 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.170500 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6324fe15-b1b7-4bc9-9b55-afc25e452177]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:22.170987 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:15:22.170987 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:22.172852 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea4fe1-68d1-4cea-a843-a54c847c704e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f] added Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:15:22.186903 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:15:23.187024 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:23.218286 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.227799 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.227799 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b803d2-8932-411a-90e9-21d4519b5585]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.233837 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.246813 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.247121 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80033d3-99e6-4c2a-ba8a-d2b5bed233cd]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.247624 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.253835 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.265414 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.265832 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd4893-04b1-4b7b-be42-33c74aec0c05]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.266124 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.268344 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v ULvb2sFUWX84P7c2wFUN {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.279403 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.username -v ULvb2sFUWX84P7c2wFUN" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.279541 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8eb59-c5a3-4c23-9930-6ae74b0d08c6]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.279850 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ULvb2sFUWX84P7c2wFUN'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.283819 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.296107 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.296286 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fe4a81-447b-4f65-8759-67eb64b35749]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.296819 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.299545 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.320801 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.320952 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded540b-012c-410e-a6bc-07fc8ab5cf4f]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.321252 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:23.321252 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:23.321325 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:23.321325 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:23.322251 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.343424 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --login" returned: 0 in 0.021s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.343612 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f98b447-617f-4601-beae-1bf628675d09]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.344034 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260] successful. Jan 26 19:15:23.344034 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.345313 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.359127 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.359243 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9187cf8-48fb-4497-b7b7-47fd55757cf5]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.359529 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:23.363119 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.374348 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.374469 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[81335eae-7820-414a-850d-c5962181899d]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.374763 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:23.374763 np0005596550.novalocal cinder-backup[194750]: tcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash) Jan 26 19:15:23.374763 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:23.374912 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:23.374912 np0005596550.novalocal cinder-backup[194750]: tcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash) Jan 26 19:15:23.374912 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:23.375197 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:23.375326 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:15:23.375743 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] HCTL ('3', '-', '-', 0) found on session 24 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:15:23.375878 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:15:23.377084 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:23.404281 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.027s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:23.406103 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3057c-4187-485d-b5e0-b7ef5d374deb]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:23.406553 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 24 and hctl ['3', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:23.771605 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:15:23.771605 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:15:24.408751 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 24 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:24.409444 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f', 'target_lun': 0, 'volume_id': '6af402df-3843-4a4d-a056-815956f2c91f', 'auth_method': 'CHAP', 'auth_username': 'ULvb2sFUWX84P7c2wFUN', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:15:24.410135 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.270s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:24.410375 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2270ms) {'type': 'block', 'scsi_wwn': '36001405f7a1da0582924c3c960078f6f', 'path': '/dev/sdb'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:24.411319 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:24.444979 np0005596550.novalocal sudo[232954]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 26 19:15:24.816790 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.401s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:24.821285 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:15:24.832788 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] _create_container started, container: tempest-volumesbackupstest-backup-container-346343214,backup: 5a277df6-85f7-4858-8b96-0c9364da2aa9. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:15:25.290130 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9 {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:15:25.374053 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] starting backup of volume: d438bc89-fce8-47ba-bf8f-fd79987670fc, volume size: 1073741824, object names prefix volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:15:25.702553 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:25.833600 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:25.833600 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:26.038389 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:26.038543 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:26.397568 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:26.532188 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:26.532309 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:26.769167 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:26.769581 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:26.923240 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:27.059884 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:27.060019 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:27.184558 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:27.184696 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:27.518450 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:27.625850 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:27.626078 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:27.795246 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:27.795894 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:28.017636 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:28.123214 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:28.123630 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:28.283205 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:28.283347 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:28.415362 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:28.524164 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:28.524164 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:28.649354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:28.649354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:28.821673 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:29.011644 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:29.011644 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:29.156011 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:29.156011 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:29.312579 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:29.469163 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:29.469375 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:29.663644 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:29.663644 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:29.808385 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:29.920286 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:29.920666 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:30.100457 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:30.100566 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:30.458929 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:30.586667 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:30.587001 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:30.730133 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:30.730337 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:31.280545 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:31.417340 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:31.417507 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:31.549484 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:31.549484 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:31.682614 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:31.818888 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:31.819015 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:32.055938 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:32.055938 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:32.198275 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:32.333354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:32.333354 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:32.537126 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:32.537312 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:32.698114 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:32.827501 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:32.827501 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:33.537541 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:33.537963 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:33.915547 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:34.110613 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:34.110921 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:34.252271 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:34.252501 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:35.075873 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:35.194063 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:35.194407 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:35.472875 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:35.473220 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:35.636363 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:35.763688 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:35.763839 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:35.882949 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:35.883122 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:36.258507 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:36.387724 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:36.387868 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:36.520997 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:36.521148 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:36.891550 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:37.024837 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:37.024968 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:37.149744 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:37.149891 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:37.305284 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:37.420440 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:37.420625 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:37.545387 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:37.545491 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:37.642783 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:15:37.710226 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:15:37.710336 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:15:37.793866 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup MD5 for volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:15:37.793866 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:15:37.798448 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:15:37.809269 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:15:37.809582 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:15:37.813822 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:15:37.814087 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:15:37.817327 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:15:37.817734 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-346343214, sha256file filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:15:37.910981 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:15:37.910981 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-346343214, metadata filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:15:37.958778 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5a277df6-85f7-4858-8b96-0c9364da2aa9",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1101682290",\n "created_at": "2026-01-27 00:15:16+00:00",\n "objects": [\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d438bc89-fce8-47ba-bf8f-fd79987670fc",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d438bc89-fce8-47ba-bf8f-fd79987670fc\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:14:08.000000\\", \\"launched_at\\": \\"2026-01-27T00:14:09.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2008515534\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc 0\\", \\"provider_auth\\": \\"CHAP MZ4Dn2rVMJZW8cBoWJ6w rExAB8c8ALuAJv9D\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:14:08.000000\\", \\"updated_at\\": \\"2026-01-27T00:15:16.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:15:37.962407 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] backup 5a277df6-85f7-4858-8b96-0c9364da2aa9 finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:15:38.042428 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.065430 np0005596550.novalocal sudo[233031]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 26 19:15:38.446495 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.404s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.447587 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f', 'target_lun': 0, 'volume_id': '6af402df-3843-4a4d-a056-815956f2c91f', 'auth_method': 'CHAP', 'auth_username': 'ULvb2sFUWX84P7c2wFUN', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405f7a1da0582924c3c960078f6f', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:38.447835 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:38.448342 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:38.451678 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.462562 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.462738 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b3c91-49d3-4faf-8c6f-6cfa0bf76bcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:38.463159 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:38.463388 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:15:38.463388 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:15:38.463388 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:15:38.463806 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:15:38.464481 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.473711 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.473922 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d2e8a-bf58-4205-9a47-6c8f5ae67a2c]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.475379 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.483370 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.483533 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c486a8c-e6f6-4d47-8225-5c3fe0f3b3ab]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: tcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash) Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: tcp: [24] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f (non-flash) Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:38.484783 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23740e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f'): ({'sdb'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:15:38.485056 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sdb {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:15:38.485664 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.491787 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c413afe2-22be-49af-8897-b0ed5d61f190]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:15:38.492367 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:15:38.494926 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c413afe2-22be-49af-8897-b0ed5d61f190]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.494926 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sdb {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:15:38.494926 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.501197 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.501197 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[85198864-fb23-471d-ac96-68447cbcb21d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.501197 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:15:38.501792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.535523 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.535677 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a6c14-38c7-400e-a10c-5e8f7f591caf]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.536030 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:15:38.536285 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:15:38.536722 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:15:38.537483 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.552431 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.552517 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f620e-a747-4a23-a769-49862f91f4d6]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.552828 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:38.558486 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.581920 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --logout" returned: 0 in 0.027s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.581969 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7941f3-8a31-4469-93ca-c0d2691fcd20]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.582266 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260] Jan 26 19:15:38.582266 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f, portal: 38.102.83.18,3260] successful. Jan 26 19:15:38.582266 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:38.584016 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:38.592634 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-6af402df-3843-4a4d-a056-815956f2c91f -p 38.102.83.18:3260 --op delete" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:38.593072 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0f8bc7-1232-45ed-8ba9-c2c0d3b4db7f]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:38.595300 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:38.595300 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.145s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:38.595300 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (146ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:42.139556 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-b29362f3-663c-42e4-893c-d94e93b91725 tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: 5a277df6-85f7-4858-8b96-0c9364da2aa9. Jan 26 19:15:42.703457 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: 6e58e644-31ab-4e7d-9fe5-a6097416002a volume: d438bc89-fce8-47ba-bf8f-fd79987670fc. Jan 26 19:15:42.703457 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-01-27T00:15:42Z,data_timestamp=2026-01-27T00:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=6e58e644-31ab-4e7d-9fe5-a6097416002a,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(5a277df6-85f7-4858-8b96-0c9364da2aa9),parent_id='5a277df6-85f7-4858-8b96-0c9364da2aa9',project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=d438bc89-fce8-47ba-bf8f-fd79987670fc) Jan 26 19:15:44.435485 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:15:44.435955 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:15:44.436017 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:44.438229 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:44.449000 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:44.449437 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dca76f-10ff-4009-9f7f-26d3df8a6f12]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e41697d6-52b6-4c04-b534-20a15c80461d]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:44.450993 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:15:44.451295 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41697d6-52b6-4c04-b534-20a15c80461d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:44.451699 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:15:44.452015 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:15:44.454003 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:44.461517 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:44.462254 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f300508-f1f1-4d5b-9b07-c2af3eca07af]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:44.463190 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:44.479521 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.016s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:44.480105 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f67d9-26c9-4a99-a97c-3a8cbd968e5f]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:44.481515 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832d892-c7d4-4a7d-a576-c9e9a6a4f3da]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:44.481830 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:44.494631 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:44.494883 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:15:44.496684 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:15:44.497746 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c'] Jan 26 19:15:44.497951 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:15:44.498024 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:15:44.498305 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:48.007672 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:15:48.008457 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737', 'target_lun': 0, 'volume_id': 'ab708d6e-762e-49dc-a47b-f27cba340737', 'auth_method': 'CHAP', 'auth_username': 'FRjdzkNua7bXv3crdYvH', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:48.008557 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:48.008993 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:48.009159 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737', 'target_lun': 0, 'volume_id': 'ab708d6e-762e-49dc-a47b-f27cba340737', 'auth_method': 'CHAP', 'auth_username': 'FRjdzkNua7bXv3crdYvH', 'auth_password': 'i8kNd6KUryxa9AvL', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:15:48.012306 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:48.014392 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[95087006-a9a6-4dec-ae35-23cbe40abdcc]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:15:48.015677 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:15:48.016875 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[95087006-a9a6-4dec-ae35-23cbe40abdcc]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:48.017939 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:48.018400 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:48.018588 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:48.020427 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:48.028919 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260" returned: 21 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:48.029113 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a94f9f-519c-4e23-979e-0c7c13411bd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:48.029506 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:15:48.029506 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:48.033117 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:48.041208 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:48.041744 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[87601356-eaa4-40d7-8366-f7c81ca29d20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:48.042132 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737] added Jan 26 19:15:48.042132 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:15:48.042132 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:48.042132 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:15:48.042132 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:48.042644 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:15:48.042920 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:15:48.043079 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:15:49.044557 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:15:49.045470 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.053196 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.053396 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[02324071-8a6b-4b4f-9efe-b3579fdfb1ea]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:15:49.054270 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.055727 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.065820 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.066188 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99e3ba-246a-4d13-a473-802e7a09da80]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.066531 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.069591 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.075639 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.075820 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[873074d7-cdf5-45b5-a69c-775bb30f64fd]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.076149 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.076943 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v FRjdzkNua7bXv3crdYvH {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.083577 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v FRjdzkNua7bXv3crdYvH" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.084224 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c6f2c9-42e4-4bbc-aa41-bfd70a762419]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.084548 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FRjdzkNua7bXv3crdYvH'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.087832 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.097733 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.097868 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc23281d-75ce-4d7f-9615-bbfbd3a3941f]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.098283 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.099224 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.108262 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.108755 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e82e3-fc04-4df8-9c47-f158c96956c1]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.109147 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:49.109147 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:49.109284 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:49.109284 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:49.111792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.130388 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.130548 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c3ac9-f2ce-4ae0-9621-674e12b20e5a]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.130986 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260] successful. Jan 26 19:15:49.130986 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.134072 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.146757 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.146992 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a52e1-171c-4a11-a70e-01b8e88bfb93]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.147269 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:49.149806 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.157811 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.157970 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb4d88-3f41-4686-ab15-bd55f5920757]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.158372 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:49.158372 np0005596550.novalocal cinder-backup[194750]: tcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash) Jan 26 19:15:49.158372 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:49.158541 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:49.158541 np0005596550.novalocal cinder-backup[194750]: tcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash) Jan 26 19:15:49.158541 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:49.158877 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:49.159056 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:15:49.159653 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] HCTL ('3', '-', '-', 0) found on session 25 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:15:49.159862 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:15:49.161092 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:49.181570 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.020s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:49.182350 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204d662-4f7a-4940-beb3-0f4bedbc730a]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:49.182960 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 25 and hctl ['3', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:50.184720 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 25 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:15:50.185224 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737', 'target_lun': 0, 'volume_id': 'ab708d6e-762e-49dc-a47b-f27cba340737', 'auth_method': 'CHAP', 'auth_username': 'FRjdzkNua7bXv3crdYvH', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:15:50.190572 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:50.191055 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2182ms) {'type': 'block', 'scsi_wwn': '36001405273013a21691446ca12e63d32', 'path': '/dev/sdb'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:15:50.191579 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:50.229463 np0005596550.novalocal sudo[233325]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 26 19:15:50.599430 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.407s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:50.616335 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:15:50.629806 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-346343214, sha256 filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_sha256file. {{(pid=194750) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:336}} Jan 26 19:15:50.675797 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _read_sha256file finished. {{(pid=194750) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:343}} Jan 26 19:15:50.687421 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _create_container started, container: volumebackups,backup: 6e58e644-31ab-4e7d-9fe5-a6097416002a. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:15:50.761820 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:15:50.766614 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] starting backup of volume: d438bc89-fce8-47ba-bf8f-fd79987670fc, volume size: 1073741824, object names prefix volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:15:55.706637 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:15:55.719255 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:15:55.719441 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:15:55.725283 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:15:55.725406 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:15:55.730119 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:15:55.731658 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:15:55.835427 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:15:55.836016 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:15:55.881204 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6e58e644-31ab-4e7d-9fe5-a6097416002a",\n "backup_name": null,\n "created_at": "2026-01-27 00:15:42+00:00",\n "objects": [],\n "parent_id": "5a277df6-85f7-4858-8b96-0c9364da2aa9",\n "version": "1.0.0",\n "volume_id": "d438bc89-fce8-47ba-bf8f-fd79987670fc",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d438bc89-fce8-47ba-bf8f-fd79987670fc\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:14:08.000000\\", \\"launched_at\\": \\"2026-01-27T00:14:09.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2008515534\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc 0\\", \\"provider_auth\\": \\"CHAP MZ4Dn2rVMJZW8cBoWJ6w rExAB8c8ALuAJv9D\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:14:08.000000\\", \\"updated_at\\": \\"2026-01-27T00:15:42.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:15:55.888632 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] backup 6e58e644-31ab-4e7d-9fe5-a6097416002a finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:15:55.973281 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:55.991840 np0005596550.novalocal sudo[233388]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 26 19:15:56.320345 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.347s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.321204 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737', 'target_lun': 0, 'volume_id': 'ab708d6e-762e-49dc-a47b-f27cba340737', 'auth_method': 'CHAP', 'auth_username': 'FRjdzkNua7bXv3crdYvH', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405273013a21691446ca12e63d32', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:15:56.321421 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:15:56.321858 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:15:56.323048 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.336697 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.337527 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df140671-40b3-44ed-a712-4be53c9737d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:15:56.337794 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:56.338029 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:15:56.338029 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:15:56.338029 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:15:56.338240 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:15:56.338923 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.349153 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.349426 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7eb424-77dd-4d46-b3e1-823649ca8a49]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.350238 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.363027 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.363148 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb0e9e-8eac-4914-88bb-e8e2da4135da]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.363415 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:56.363415 np0005596550.novalocal cinder-backup[194750]: tcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash) Jan 26 19:15:56.363415 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:15:56.363538 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:15:56.363538 np0005596550.novalocal cinder-backup[194750]: tcp: [25] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 (non-flash) Jan 26 19:15:56.363538 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:15:56.364055 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad23ba8e0>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737'): ({'sdb'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:15:56.364249 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sdb {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:15:56.364924 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.371426 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[52422eac-de78-41c8-9256-ce1102624fd6]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:15:56.372974 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:15:56.373387 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[52422eac-de78-41c8-9256-ce1102624fd6]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.373872 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sdb {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:15:56.374459 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.381485 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.381903 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded433f0-6916-49bb-ba6e-5f573a0ffc72]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.382124 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:15:56.382743 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.457867 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.458029 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45d4c6-2c45-4220-972e-af8c328a132f]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.458430 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:15:56.458589 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:15:56.459737 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:15:56.461312 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.474056 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.474145 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d85fa-cc9c-4dfb-9d6e-635d8d1fb944]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.474587 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:56.475354 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.513321 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --logout" returned: 0 in 0.037s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.513425 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d1405-7d28-46a0-8d82-4b080633487a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.513822 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260] Jan 26 19:15:56.513822 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737, portal: 38.102.83.18,3260] successful. Jan 26 19:15:56.513822 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:56.514466 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:15:56.526023 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-ab708d6e-762e-49dc-a47b-f27cba340737 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:15:56.526224 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728fe70-2f14-4efd-b968-732877d64de7]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:15:56.526489 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:15:56.526834 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.205s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:15:56.526985 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (205ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:00.599801 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-47f124cb-1626-40cf-8c14-84467f211ec1 tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: 6e58e644-31ab-4e7d-9fe5-a6097416002a. Jan 26 19:16:01.359646 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: 6e58e644-31ab-4e7d-9fe5-a6097416002a. Jan 26 19:16:01.359646 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:16:01.359646 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:16:01.359646 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] delete started, backup: 6e58e644-31ab-4e7d-9fe5-a6097416002a, container: volumebackups, prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:16:01.439832 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_metadata', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:16:01.489639 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_metadata in container: volumebackups. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:01.529417 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001550/az_nova_backup_6e58e644-31ab-4e7d-9fe5-a6097416002a_sha256file in container: volumebackups. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:01.529616 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] delete 6e58e644-31ab-4e7d-9fe5-a6097416002a finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:16:01.535161 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:16:01.613627 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] Created reservations ['07a54aac-a71b-45fd-be65-4f974775015f', 'b913ff6b-c3e1-4c7e-b61b-604c3187999f'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:16:01.726651 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-0d27ecac-b51e-4555-b072-0a4c6b03f8d5 tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup 6e58e644-31ab-4e7d-9fe5-a6097416002a deleted. Jan 26 19:16:02.747371 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Create backup started, backup: 9330a24d-929e-4674-9893-1e1da256acec volume: d438bc89-fce8-47ba-bf8f-fd79987670fc. Jan 26 19:16:02.755762 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-568024947',created_at=2026-01-27T00:16:02Z,data_timestamp=2026-01-27T00:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1243615841',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=9330a24d-929e-4674-9893-1e1da256acec,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(5a277df6-85f7-4858-8b96-0c9364da2aa9),parent_id='5a277df6-85f7-4858-8b96-0c9364da2aa9',project_id='261cb1c98c954302ba86efa2ceee43f2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e6cbe3740f6c4303bbf3e5d5c92677db',volume_id=d438bc89-fce8-47ba-bf8f-fd79987670fc) Jan 26 19:16:04.213574 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:16:04.214058 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:16:04.214058 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:16:04.218012 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:04.226004 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:04.226175 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c0ece-847e-4ff1-9cf1-785a76d08707]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b121178f-84a8-4fd5-9dd6-d4b11d2f4fe1]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:04.229607 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:16:04.229966 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121178f-84a8-4fd5-9dd6-d4b11d2f4fe1]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:04.230469 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:16:04.230815 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:16:04.232791 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:04.238962 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:04.239138 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[78818f37-e296-47fc-8c4b-805c6744bcb7]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:04.243848 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:04.249987 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:04.250406 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c63488-92fd-4dca-8e2b-ea41111cfe1b]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:04.251545 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bcb498-0063-473a-b773-1b98d38cb591]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:04.252003 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:04.264921 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:16:04.265157 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:16:04.266899 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:16:04.267750 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c'] Jan 26 19:16:04.267906 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:16:04.268017 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:16:04.268358 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48', 'fe80::fc16:3eff:feeb:a58e', 'fe80::f445:7cff:fe9c:99d4', 'fe80::fc16:3eff:feee:b36b', 'fe80::3066:e1ff:fed0:543d', 'fe80::fc16:3eff:fe21:d52c']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:08.278513 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:16:08.279288 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8', 'target_lun': 0, 'volume_id': 'bd62c495-aa86-4e54-8d14-600590804ee8', 'auth_method': 'CHAP', 'auth_username': 'QeD7x45xnAkqMLPWN64X', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:16:08.279461 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:16:08.279899 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:16:08.280039 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8', 'target_lun': 0, 'volume_id': 'bd62c495-aa86-4e54-8d14-600590804ee8', 'auth_method': 'CHAP', 'auth_username': 'QeD7x45xnAkqMLPWN64X', 'auth_password': 'm5S2LuSXgb2RLJRc', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:16:08.280880 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:08.287091 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5c1a8fdd-eee7-41dc-89a4-c672c0aafa64]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:16:08.293447 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:16:08.296969 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a8fdd-eee7-41dc-89a4-c672c0aafa64]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:08.298204 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:16:08.299203 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:16:08.299774 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:16:08.301349 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:08.311180 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260" returned: 21 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:08.311349 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972ed80-f1a8-4969-9bd5-21e132aa2483]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:08.311819 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:16:08.311819 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:08.312478 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:08.319557 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:08.319711 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbaafc2-b402-47ac-b890-bfaeb21b8912]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:08.320044 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8] added Jan 26 19:16:08.320044 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:16:08.320044 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:16:08.320044 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:16:08.320044 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:08.320212 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:16:08.321074 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:16:08.321365 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:16:09.326987 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:16:09.328198 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.339329 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.339491 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0a23f-7d37-4d71-bb34-45dbc66a6430]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:16:09.340566 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.342698 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.349734 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.349888 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d1d81e-259f-4553-9f7c-ba30b392614f]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.350161 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.350878 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.362057 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.011s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.362423 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e78d12-601a-4bfc-bed4-4962a9cb0bdd]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.362842 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.363637 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v QeD7x45xnAkqMLPWN64X {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.375792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v QeD7x45xnAkqMLPWN64X" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.375792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[198564b9-a3e2-452c-94d7-d70f03d0127c]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.375792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeD7x45xnAkqMLPWN64X'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.375792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.384060 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.384354 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d8c415-d34b-4df6-bdc1-9b0b38b6fb99]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.385037 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.386026 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.394822 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.395726 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7198cc-aa4a-4faf-b59b-75fd29dbf304]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.395726 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:09.395726 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:09.395895 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:09.395895 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:16:09.396779 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.416823 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --login" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.416823 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5152c7-d21f-4227-bebc-b482980d3935]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.416823 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260] successful. Jan 26 19:16:09.416823 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.418457 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.430591 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.430707 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[361479b3-88f3-4ddf-b9d5-f95173cdb51f]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.432504 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:09.433590 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e79a3-184c-4b15-8713-6f6c359fdb5f]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: tcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash) Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: tcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash) Jan 26 19:16:09.443844 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:16:09.444167 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:16:09.444365 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:16:09.445149 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] HCTL ('3', '-', '-', 0) found on session 26 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:16:09.445149 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:16:09.446254 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:09.468404 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:09.468557 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8623506-dc2f-45bc-b8f9-1baebbdc5343]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:09.469069 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 26 and hctl ['3', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:16:10.470415 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Searching for a device in session 26 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:16:10.470918 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8', 'target_lun': 0, 'volume_id': 'bd62c495-aa86-4e54-8d14-600590804ee8', 'auth_method': 'CHAP', 'auth_username': 'QeD7x45xnAkqMLPWN64X', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:16:10.471530 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.192s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:16:10.471710 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] <== connect_volume: return (2192ms) {'type': 'block', 'scsi_wwn': '3600140521e6c1a9592445c8b2bb1f524', 'path': '/dev/sdb'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:10.472034 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:10.499184 np0005596550.novalocal sudo[233731]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 26 19:16:10.883587 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.411s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:10.887059 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:16:10.888398 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=84,cinder:UPDATE=23,cinder:INSERT=2 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:16:10.893268 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-346343214, sha256 filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_sha256file. {{(pid=194750) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:336}} Jan 26 19:16:10.925785 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _read_sha256file finished. {{(pid=194750) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:343}} Jan 26 19:16:10.942417 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _create_container started, container: tempest-volumesbackupstest-backup-container-568024947,backup: 9330a24d-929e-4674-9893-1e1da256acec. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:16:11.007803 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] generate_object_name_prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:16:11.016031 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] starting backup of volume: d438bc89-fce8-47ba-bf8f-fd79987670fc, volume size: 1073741824, object names prefix volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:16:15.083824 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:16:15.092119 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:16:15.092415 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:16:15.096183 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:16:15.096360 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:16:15.099489 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:16:15.099579 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-568024947, sha256file filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:16:15.186790 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:16:15.187550 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-568024947, metadata filename: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:16:15.224605 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9330a24d-929e-4674-9893-1e1da256acec",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1243615841",\n "created_at": "2026-01-27 00:16:02+00:00",\n "objects": [],\n "parent_id": "5a277df6-85f7-4858-8b96-0c9364da2aa9",\n "version": "1.0.0",\n "volume_id": "d438bc89-fce8-47ba-bf8f-fd79987670fc",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d438bc89-fce8-47ba-bf8f-fd79987670fc\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e6cbe3740f6c4303bbf3e5d5c92677db\\", \\"project_id\\": \\"261cb1c98c954302ba86efa2ceee43f2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:14:08.000000\\", \\"launched_at\\": \\"2026-01-27T00:14:09.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-2008515534\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc 0\\", \\"provider_auth\\": \\"CHAP MZ4Dn2rVMJZW8cBoWJ6w rExAB8c8ALuAJv9D\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:14:08.000000\\", \\"updated_at\\": \\"2026-01-27T00:16:02.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:16:15.239728 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] backup 9330a24d-929e-4674-9893-1e1da256acec finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:16:15.313072 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.335531 np0005596550.novalocal sudo[233796]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 26 19:16:15.660004 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.346s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.660004 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8', 'target_lun': 0, 'volume_id': 'bd62c495-aa86-4e54-8d14-600590804ee8', 'auth_method': 'CHAP', 'auth_username': 'QeD7x45xnAkqMLPWN64X', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3600140521e6c1a9592445c8b2bb1f524', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:16:15.660276 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:16:15.660547 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:16:15.662647 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.669945 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.670124 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec0f0dc-1b4f-461d-9853-abf0e3de3705]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:16:15.670454 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:15.670734 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:16:15.670734 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:16:15.670734 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:16:15.671084 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:16:15.671726 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.677340 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.677472 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94bd35-a139-470b-a73c-5eee53d1b8fa]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8\n38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.678301 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.685024 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.685168 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d3a8b-b632-4343-8f59-4d6ba4879577]: (4, ('tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash)\ntcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.685435 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:15.685435 np0005596550.novalocal cinder-backup[194750]: tcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash) Jan 26 19:16:15.685435 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:16:15.685576 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsi session list stdout=tcp: [23] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-d438bc89-fce8-47ba-bf8f-fd79987670fc (non-flash) Jan 26 19:16:15.685576 np0005596550.novalocal cinder-backup[194750]: tcp: [26] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 (non-flash) Jan 26 19:16:15.685576 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:16:15.686088 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Resulting device map defaultdict(. at 0x7fdad276fb00>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8'): ({'sdb'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:16:15.686300 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Removing single pathed devices sdb {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:16:15.687112 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.693304 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b8f42bfb-2e90-4f4c-bedf-4537ca9beaa1]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:16:15.694889 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:16:15.696436 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f42bfb-2e90-4f4c-bedf-4537ca9beaa1]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.696864 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Flushing IO for device /dev/sdb {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:16:15.697573 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.702792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.004s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.702792 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[31490be3-5c2f-4955-a7ec-0ec0344029f7]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.702792 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:16:15.703416 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.750713 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.750972 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61b5b1-ee95-4fd2-92cb-747cd971b966]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.751291 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:16:15.751490 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] SCSI volumes sdb have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:16:15.752089 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:16:15.752937 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.764488 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.764488 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8119ff-619e-4bfe-957d-7aea9a6b992f]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.764488 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:15.765340 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.801082 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --logout" returned: 0 in 0.035s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.801273 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62e280-3beb-4c30-a5a9-9f1f4116bf3a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.801666 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260] Jan 26 19:16:15.801666 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8, portal: 38.102.83.18,3260] successful. Jan 26 19:16:15.801666 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:15.802402 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:16:15.810622 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-bd62c495-aa86-4e54-8d14-600590804ee8 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:16:15.810798 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc99ce7-8129-44e0-8216-e2fa943f8660]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:16:15.811090 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:16:15.811400 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.151s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:16:15.811603 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] <== disconnect_volume: return (151ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:16:19.369917 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-4b032fc3-4cd7-4389-bdb8-6ac103996a0b tempest-VolumesBackupsTest-97611117 None] Create backup finished. backup: 9330a24d-929e-4674-9893-1e1da256acec. Jan 26 19:16:20.277139 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: 9330a24d-929e-4674-9893-1e1da256acec. Jan 26 19:16:20.277967 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:16:20.278097 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:16:20.278232 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] delete started, backup: 9330a24d-929e-4674-9893-1e1da256acec, container: tempest-volumesbackupstest-backup-container-568024947, prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:16:20.364340 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_metadata', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:16:20.392713 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_metadata in container: tempest-volumesbackupstest-backup-container-568024947. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:20.430008 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001611/az_nova_backup_9330a24d-929e-4674-9893-1e1da256acec_sha256file in container: tempest-volumesbackupstest-backup-container-568024947. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:20.430207 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] delete 9330a24d-929e-4674-9893-1e1da256acec finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:16:20.435707 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:16:20.479615 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] Created reservations ['845b7aff-0480-4d39-b55a-527d1f5cb9bd', '67d244a1-20de-4754-85e7-f28e647c3526'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:16:20.503324 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-2f1885e6-9a41-40b9-993f-9e77c7e35b44 tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup 9330a24d-929e-4674-9893-1e1da256acec deleted. Jan 26 19:16:21.497211 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] Delete backup started, backup: 5a277df6-85f7-4858-8b96-0c9364da2aa9. Jan 26 19:16:21.501445 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_261cb1c98c954302ba86efa2ceee43f2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:16:21.501573 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:16:21.501721 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] delete started, backup: 5a277df6-85f7-4858-8b96-0c9364da2aa9, container: tempest-volumesbackupstest-backup-container-346343214, prefix: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:16:21.568195 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] generated object list: ['volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00001', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00002', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00003', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00004', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00005', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00006', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00007', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00008', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00009', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00010', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00011', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00012', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00013', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00014', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00015', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00016', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00017', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00018', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00019', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00020', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00021', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_metadata', 'volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:16:21.836480 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00001 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.098855 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00002 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.336664 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00003 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.537645 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00004 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.734921 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00005 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.783942 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00006 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.814184 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00007 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.855218 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00008 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.888941 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00009 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.931795 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00010 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:22.984061 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00011 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.024447 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00012 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.066127 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00013 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.105219 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00014 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.142974 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00015 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.180365 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00016 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.217564 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00017 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.269161 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00018 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.301107 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00019 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.327718 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00020 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.368151 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9-00021 in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.406144 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_metadata in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.451348 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] deleted object: volume_d438bc89-fce8-47ba-bf8f-fd79987670fc/20260127001525/az_nova_backup_5a277df6-85f7-4858-8b96-0c9364da2aa9_sha256file in container: tempest-volumesbackupstest-backup-container-346343214. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:16:23.451348 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] delete 5a277df6-85f7-4858-8b96-0c9364da2aa9 finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:16:23.454461 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:16:23.490267 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] Created reservations ['5c58aa24-0407-4686-b784-36dfcc5dc559', '4f1df5bb-5244-478c-a90d-b3aa23a643f3'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:16:23.533180 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-a1b68244-ef35-444a-929d-fbb2e5d66b10 tempest-VolumesBackupsTest-97611117 None] Delete backup finished, backup 5a277df6-85f7-4858-8b96-0c9364da2aa9 deleted. Jan 26 19:16:23.768517 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:16:23.768517 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:16:33.530547 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=46,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:17:23.752553 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:17:23.772638 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:17:23.772926 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:18:23.768889 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:18:23.769424 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:19:23.753068 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:19:23.767631 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:19:23.767913 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:20:23.774132 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:20:23.774839 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:21:23.762384 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:21:23.770431 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:21:23.770578 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:22:23.774241 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:22:23.774241 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:23:23.761742 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:23:23.777090 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:23:23.777090 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:24:23.780931 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:24:23.780931 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:25:23.763381 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:25:23.784226 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:25:23.784447 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:26:23.789244 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:26:23.789664 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:27:23.766986 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:27:23.792824 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:27:23.792943 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:28:23.796231 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:28:23.796629 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:29:23.768930 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:29:23.799181 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:29:23.799413 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:30:02.345558 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Create backup started, backup: 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6 volume: 1b2c7232-baa1-4e1f-87b0-e90b753784e9. Jan 26 19:30:02.350295 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-1756897585',created_at=2026-01-27T00:30:02Z,data_timestamp=2026-01-27T00:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1926965740',encryption_key_id=None,fail_reason=None,host='np0005596550.novalocal',id=3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='033253b194484f43acb50931620fa7c2',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='360d6ec9770c4cf9a4661a9b68fbba8b',volume_id=1b2c7232-baa1-4e1f-87b0-e90b753784e9) Jan 26 19:30:02.381163 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_033253b194484f43acb50931620fa7c2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:30:02.381401 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:30:02.381550 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.18', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:30:02.382870 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:02.395593 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:02.395892 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c7886-83e3-4be0-aa26-1f26ede535dc]: (4, ('InitiatorName=iqn.1994-05.com.redhat:cea4a155eb24\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a296188f-7308-4218-9c33-7791c3e8c5d3]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: with open_scini_device() as fd: Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: return next(self.gen) Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:02.398498 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 26 19:30:02.399256 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296188f-7308-4218-9c33-7791c3e8c5d3]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:02.399256 np0005596550.novalocal cinder-backup[194750]: ERROR os_brick.initiator.connectors.scaleio [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 26 19:30:02.399256 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.scaleio [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 26 19:30:02.400017 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:02.412935 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:02.413305 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11b300-bc6c-44be-9ffb-eb86321ba25d]: (4, ('/dev/vda2\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:02.414021 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:02.423497 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:02.424022 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370e8dd-514d-478c-bbd0-1ef87c27a837]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:02.425584 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd574e43-2df2-428e-a644-ec97d4169081]: (4, 'aeb36add-7571-4189-bbee-cf222c12d743') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:02.426237 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Running cmd (subprocess): nvme version {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:02.439805 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] 'nvme version' failed. Not Retrying. {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:30:02.440120 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] nvme not present on system {{(pid=194750) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 26 19:30:02.441498 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=194750) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 26 19:30:02.442231 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.lightos [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48'] Jan 26 19:30:02.442409 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 26 19:30:02.442558 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.lightos [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=194750) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 26 19:30:02.442837 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] <== get_connector_properties: return (61ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.18', 'host': 'np0005596550.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:cea4a155eb24', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': 'aeb36add-7571-4189-bbee-cf222c12d743', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.18', 'fe80::f816:3eff:fe00:50ac', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::2041:f2ff:fefa:2a48']} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:30:05.950789 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connector [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Factory for iscsi on None {{(pid=194750) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 26 19:30:05.951542 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'target_lun': 0, 'volume_id': '1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'auth_method': 'CHAP', 'auth_username': 'x266Tst7SFLHxD7Mb3tK', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:30:05.951744 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:30:05.952297 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:30:05.952375 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'target_lun': 0, 'volume_id': '1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'auth_method': 'CHAP', 'auth_username': 'x266Tst7SFLHxD7Mb3tK', 'auth_password': 'RM5iKmejVoecyvXd', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=194750) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 26 19:30:05.953205 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:05.958845 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e3a47b51-26cf-416f-91d0-d03dcb8c639f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:30:05.961886 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:30:05.963752 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a47b51-26cf-416f-91d0-d03dcb8c639f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:05.964433 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:30:05.965099 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:30:05.965427 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:30:05.967186 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:05.978267 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260" returned: 21 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:05.978884 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5249a4d-aa90-4d5e-9970-f7f93e09a865]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:05.979344 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 26 19:30:05.979344 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:05.980468 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --interface default --op new {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:05.990826 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:05.991189 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce57f44f-cec0-42d7-b1b5-7120ff39ca5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:05.991494 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.18,3260,-1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9] added Jan 26 19:30:05.991494 np0005596550.novalocal cinder-backup[194750]: stderr=iscsiadm: Config file line 381 does not have value Jan 26 19:30:05.991494 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:30:05.991494 np0005596550.novalocal cinder-backup[194750]: iscsiadm: Config file line 381 does not have value Jan 26 19:30:05.991494 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:05.991675 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Retrying to connect to iSCSI portal 38.102.83.18:3260 {{(pid=194750) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 26 19:30:05.992175 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 26 19:30:05.992392 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.utils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=194750) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 26 19:30:06.994317 np0005596550.novalocal cinder-backup[194750]: INFO os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Trying to connect to iSCSI portal 38.102.83.18:3260 Jan 26 19:30:06.996344 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.003642 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260" returned: 0 in 0.008s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.004874 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a79bd7-cebc-480b-b2b0-5408b829ec4a]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.18\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.name = iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.tpgt = -1 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.startup = automatic Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.leading_login = No Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.iscsi_ifacename = default Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.net_ifacename = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.ipaddress = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.prefix_len = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.hwaddress = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.transport_name = tcp Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.initiatorname = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.vlan_id = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.vlan_priority = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.vlan_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.iface_num = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.mtu = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.port = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.bootproto = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.subnet_mask = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.gateway = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_alt_client_id = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_dns = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_learn_iqn = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_req_vendor_id_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_vendor_id = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.dhcp_slp_da = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.fragmentation = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.gratuitous_arp = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.incoming_forwarding = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tos_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tos = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.ttl = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.delayed_ack = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tcp_nagle = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf_state = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tcp_wsf = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timer_scale = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.tcp_timestamp = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.redirect = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.def_task_mgmt_timeout = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.header_digest = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.data_digest = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.immediate_data = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.initial_r2t = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.data_seq_inorder = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.data_pdu_inorder = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.erl = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.max_receive_data_len = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.first_burst_len = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.max_outstanding_r2t = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.max_burst_len = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.chap_auth = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.bidi_chap = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.strict_login_compliance = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.discovery_auth = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: iface.discovery_logout = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.discovery_address = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.discovery_port = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.discovery_type = fw Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.initial_cmdsn = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.initial_login_retry_max = 8 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.xmit_thread_priority = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.cmds_max = 128 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.queue_depth = 32 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.nr_sessions = 1 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.authmethod = None Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password = *** Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.username_in = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.password_in = Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.timeo.replacement_timeout = 120 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.abort_timeout = 15 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.lu_reset_timeout = 30 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.err_timeo.host_reset_timeout = 60 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FastAbort = Yes Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.InitialR2T = No Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ImmediateData = Yes Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.FirstBurstLength = 262144 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxBurstLength = 16776192 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Retain = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.DefaultTime2Wait = 2 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxConnections = 1 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.iscsi.ERL = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.scan = auto Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.reopen_max = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.session.conn_reopen_log_freq = 1 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].address = 38.102.83.18 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].port = 3260 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].startup = manual Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.window_size = 524288 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].tcp.type_of_service = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.logout_timeout = 15 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.login_timeout = 15 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.auth_timeout = 45 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_interval = 5 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].timeo.noop_out_timeout = 5 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.HeaderDigest = None Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.DataDigest = None Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.IFMarker = No Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: node.conn[0].iscsi.OFMarker = No Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: # END RECORD Jan 26 19:30:07.005253 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.007267 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.016348 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.016800 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888061d-70a4-40d0-b181-146393ad5d9b]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.017067 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.018036 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.027492 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.027786 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7311f0-3ad5-445f-8b6d-009db0b9897d]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.028119 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.028717 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v x266Tst7SFLHxD7Mb3tK {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.037614 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.username -v x266Tst7SFLHxD7Mb3tK" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.037721 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe765b3e-8340-43df-8b82-8f2624ef9f00]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.038061 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'x266Tst7SFLHxD7Mb3tK'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.038946 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v *** {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.048148 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.048544 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[364cd885-b745-418c-8f76-6ce38d778779]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.049000 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.049405 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.061159 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.061320 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8cb46-25fd-4816-83f6-bf00804b6869]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.061589 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 26 19:30:07.061589 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:30:07.061753 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 26 19:30:07.061753 np0005596550.novalocal cinder-backup[194750]: {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:30:07.061940 np0005596550.novalocal cinder-backup[194750]: WARNING os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 26 19:30:07.061940 np0005596550.novalocal cinder-backup[194750]: Jan 26 19:30:07.062586 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --login {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.076530 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --login" returned: 0 in 0.014s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.076685 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65ada4a-9cc5-4997-803c-9cfd5425f1cd]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.077006 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260] successful. Jan 26 19:30:07.077006 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.077577 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.startup -v automatic {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.087934 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.startup -v automatic" returned: 0 in 0.010s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.087934 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b178e63-2261-4ec1-860a-c2c24337fca6]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.087934 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:07.088516 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.097512 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.097800 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9efb5-6b3e-4b00-8951-805f1c6593d5]: (4, ('tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.098050 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('-m', 'session'): stdout=tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash) Jan 26 19:30:07.098050 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:30:07.098218 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsi session list stdout=tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash) Jan 26 19:30:07.098218 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:30:07.098544 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_to_iscsi_portal-38.102.83.18:3260-iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:30:07.098722 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Connected to 38.102.83.18:3260 {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 26 19:30:07.099227 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] HCTL ('2', '-', '-', 0) found on session 32 with lun 0 {{(pid=194750) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 26 19:30:07.099396 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=194750) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 26 19:30:07.100012 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:07.120522 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.018s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:07.120522 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc1a80-7c76-4ee3-8b52-95ef5c81ca23]: (4, ('- - 0', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:07.120522 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Searching for a device in session 32 and hctl ['2', '*', '*', 0] yield: None {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:30:08.122952 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Searching for a device in session 32 and hctl ['2', '*', '*', 0] yield: sda {{(pid=194750) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 26 19:30:08.122952 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'target_lun': 0, 'volume_id': '1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'auth_method': 'CHAP', 'auth_username': 'x266Tst7SFLHxD7Mb3tK', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=194750) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 26 19:30:08.122952 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.169s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:30:08.122952 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] <== connect_volume: return (2169ms) {'type': 'block', 'scsi_wwn': '36001405f699f6557b354c42a93dc3bd3', 'path': '/dev/sda'} {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:30:08.122952 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:08.149076 np0005596550.novalocal sudo[240703]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 26 19:30:08.496578 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.374s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:08.501483 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:30:08.506054 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-1756897585,backup: 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6. {{(pid=194750) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 26 19:30:08.664894 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] generate_object_name_prefix: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6 {{(pid=194750) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 26 19:30:08.671535 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] starting backup of volume: 1b2c7232-baa1-4e1f-87b0-e90b753784e9, volume size: 1073741824, object names prefix volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6, availability zone: nova {{(pid=194750) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 26 19:30:09.321105 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:09.453659 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:09.453833 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:09.578165 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:09.578371 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:09.686224 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:09.859111 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:09.859227 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:09.995874 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:09.996184 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:10.430494 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:10.528997 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:10.529138 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:10.664836 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:10.664986 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:10.999133 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:11.103494 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:11.103617 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:11.219066 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:11.219241 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:11.329975 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:11.432189 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:11.432667 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:11.553568 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:11.553859 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:11.902629 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:12.003003 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:12.003148 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:12.272112 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:12.272247 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:12.482099 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:12.632953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:12.633142 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:12.780349 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:12.780495 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:12.915416 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:13.016151 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:13.016441 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:13.222223 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:13.222652 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:13.350255 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:13.450172 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:13.450367 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:13.562273 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:13.562567 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:13.671473 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:13.782857 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:13.782980 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:13.934024 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:13.934288 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:14.119079 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:14.297788 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:14.298066 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:14.410141 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:14.410410 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:14.976062 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:15.114804 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:15.114923 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:15.228435 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:15.228692 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:15.582201 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:15.753644 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:15.753940 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:15.901267 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:15.901660 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:16.314558 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:16.476953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:16.477181 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:16.589263 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:16.589462 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:16.749097 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:16.888301 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:16.888465 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:17.009487 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:17.009706 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:17.343558 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:17.442444 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:17.442608 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:17.850408 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:17.850569 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:18.200689 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:18.322483 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:18.322653 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:18.450276 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:18.450894 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:18.578545 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:18.674802 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:18.675083 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:18.813812 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:18.813995 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:19.189881 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:19.320793 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:19.320935 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:19.466832 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:19.466832 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:19.625666 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:19.725903 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:19.726047 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:19.865302 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:19.865497 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:19.928591 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Backing up chunk of data from volume. {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 26 19:30:19.982876 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=194750) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 26 19:30:19.983033 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] About to put_object {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 26 19:30:20.048865 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup MD5 for volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 26 19:30:20.049148 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Calling eventlet.sleep(0) {{(pid=194750) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 26 19:30:20.055809 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Getting metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 26 19:30:20.064076 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=194750) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 26 19:30:20.064238 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Getting metadata type 'volume-metadata' {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 26 19:30:20.068016 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] No metadata type 'volume-metadata' available {{(pid=194750) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 26 19:30:20.068171 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Getting metadata type 'volume-glance-metadata' {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 26 19:30:20.073362 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.driver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] No metadata type 'volume-glance-metadata' available {{(pid=194750) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 26 19:30:20.073788 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-1756897585, sha256file filename: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_sha256file. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 26 19:30:20.142173 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] _write_sha256file finished. {{(pid=194750) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 26 19:30:20.143208 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-1756897585, metadata filename: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_metadata. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 26 19:30:20.171229 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-1926965740",\n "created_at": "2026-01-27 00:30:02+00:00",\n "objects": [\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1b2c7232-baa1-4e1f-87b0-e90b753784e9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1b2c7232-baa1-4e1f-87b0-e90b753784e9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"360d6ec9770c4cf9a4661a9b68fbba8b\\", \\"project_id\\": \\"033253b194484f43acb50931620fa7c2\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005596550.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-27T00:30:01.000000\\", \\"launched_at\\": \\"2026-01-27T00:30:01.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-1888863324\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.18:3260,iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 0\\", \\"provider_auth\\": \\"CHAP x266Tst7SFLHxD7Mb3tK RM5iKmejVoecyvXd\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"423298ae-9268-4d03-9cb5-063c9922a67c\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"f8367255-a1ad-4fd9-8efb-9c1ea3133c01\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-27T00:30:01.000000\\", \\"updated_at\\": \\"2026-01-27T00:30:04.000000\\"}}"\n}'. {{(pid=194750) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 26 19:30:20.176063 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] backup 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6 finished. {{(pid=194750) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 26 19:30:20.268004 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.291839 np0005596550.novalocal sudo[240715]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 26 19:30:20.615572 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.348s {{(pid=194750) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.616743 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.18:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'target_lun': 0, 'volume_id': '1b2c7232-baa1-4e1f-87b0-e90b753784e9', 'auth_method': 'CHAP', 'auth_username': 'x266Tst7SFLHxD7Mb3tK', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405f699f6557b354c42a93dc3bd3', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 26 19:30:20.616910 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 26 19:30:20.617364 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 26 19:30:20.618481 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.625059 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.006s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.625192 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca67ad-c5bf-4bfc-afc2-91e0bdf040e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9\n\tPortal: 38.102.83.18:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: iSNS: Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: STATIC: Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: Target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: Portal: 38.102.83.18:3260,-1 Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: Iface Name: default Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: FIRMWARE: Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: No targets found. Jan 26 19:30:20.625480 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:30:20.625789 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 26 19:30:20.625789 np0005596550.novalocal cinder-backup[194750]: .*?^DiscoveryAddress: 38.102.83.18,3260.*? Jan 26 19:30:20.625789 np0005596550.novalocal cinder-backup[194750]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=194750) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 26 19:30:20.625915 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9', 0)] {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 26 19:30:20.626677 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.633909 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.634020 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae29a43-3006-4296-bd14-33525ec9cd8b]: (4, ('38.102.83.18:3260,4294967295 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.634645 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.639795 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.005s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.639930 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbfa35e-0497-427c-9f27-50bd834ab1ed]: (4, ('tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash)\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.640181 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('-m', 'session'): stdout=tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash) Jan 26 19:30:20.640181 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 26 19:30:20.640309 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsi session list stdout=tcp: [32] 38.102.83.18:3260,1 iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 (non-flash) Jan 26 19:30:20.640309 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 26 19:30:20.640833 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Resulting device map defaultdict(. at 0x7fdad27eeb60>, {('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9'): ({'sda'}, set())}) {{(pid=194750) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 26 19:30:20.641051 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Removing single pathed devices sda {{(pid=194750) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 26 19:30:20.641562 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.646155 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2d263d58-6d2f-4e8f-98e9-81d970eb4e6d]: [Errno 2] No such file or directory: 'multipathd' {{(pid=222207) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: Traceback (most recent call last): Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ret = func(*f_args, **f_kwargs) Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: return func(*args, **kwargs) Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: return putils.execute(on_execute=on_execute, Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: obj = subprocess.Popen(cmd, Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: ^^^^^^^^^^^^^^^^^^^^^ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 26 19:30:20.647524 np0005596550.novalocal cinder-backup[194750]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 26 19:30:20.648167 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d263d58-6d2f-4e8f-98e9-81d970eb4e6d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.648726 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Flushing IO for device /dev/sda {{(pid=194750) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 26 19:30:20.649376 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.653100 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.004s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.653258 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a06350-574e-4ba5-a4e4-349f467fb042]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.653516 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=194750) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 26 19:30:20.654115 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.707616 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.053s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.707980 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b47f7b0-47bd-4665-83bd-2807b18817da]: (4, ('1', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.708574 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Checking to see if SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 26 19:30:20.708933 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.linuxscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] SCSI volumes sda have been removed. {{(pid=194750) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 26 19:30:20.709424 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Disconnecting from: [('38.102.83.18:3260', 'iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9')] {{(pid=194750) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 26 19:30:20.710296 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.startup -v manual {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.722129 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op update -n node.startup -v manual" returned: 0 in 0.012s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.722300 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e1a78-db12-4e56-b618-3b2f7c978b51]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.722628 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:20.723161 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --logout {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.752138 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --logout" returned: 0 in 0.029s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.753130 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[90544c3f-e478-4e9b-8918-dbd64223edf8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260] successful.\n', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.753445 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260] Jan 26 19:30:20.753445 np0005596550.novalocal cinder-backup[194750]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9, portal: 38.102.83.18,3260] successful. Jan 26 19:30:20.753445 np0005596550.novalocal cinder-backup[194750]: stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:20.753967 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op delete {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 26 19:30:20.761520 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-1b2c7232-baa1-4e1f-87b0-e90b753784e9 -p 38.102.83.18:3260 --op delete" returned: 0 in 0.007s {{(pid=222207) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 26 19:30:20.761749 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo.privsep.daemon [-] privsep: reply[77272902-3ac1-46cc-808c-d2227997a254]: (4, ('', '')) {{(pid=222207) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 26 19:30:20.761984 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=194750) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 26 19:30:20.762201 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.base [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.145s {{(pid=194750) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 26 19:30:20.762342 np0005596550.novalocal cinder-backup[194750]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] <== disconnect_volume: return (145ms) None {{(pid=194750) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 26 19:30:23.804881 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:30:23.805415 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:30:24.281889 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-3c15b512-a230-4792-b04b-f25f6a4ed2f0 tempest-VolumesBackupsV39Test-1943903562 None] Create backup finished. backup: 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6. Jan 26 19:30:24.970542 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] Delete backup started, backup: 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6. Jan 26 19:30:24.971563 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] Using swift URL https://38.102.83.18:8080/v1/AUTH_033253b194484f43acb50931620fa7c2 {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 26 19:30:24.971729 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.drivers.swift [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] Connect to https://38.102.83.18:8080/v1/AUTH_ in "per_user" mode {{(pid=194750) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 26 19:30:24.972032 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] delete started, backup: 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6, container: tempest-volumesbackupsv39test-backup-container-1756897585, prefix: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 26 19:30:25.269832 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] generated object list: ['volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00001', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00002', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00003', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00004', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00005', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00006', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00007', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00008', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00009', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00010', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00011', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00012', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00013', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00014', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00015', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00016', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00017', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00018', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00019', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00020', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00021', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_metadata', 'volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_sha256file']. {{(pid=194750) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 26 19:30:25.310739 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00001 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.346377 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00002 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.387381 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00003 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.426857 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00004 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.463563 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00005 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.500231 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00006 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.539206 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00007 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.592804 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00008 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.679666 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00009 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.718988 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00010 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.766478 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00011 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.822431 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00012 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.881559 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00013 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.936739 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00014 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:25.976249 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00015 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.009953 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00016 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.049562 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00017 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.086813 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00018 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.108331 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00019 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.132306 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00020 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.156063 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6-00021 in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.184874 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_metadata in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.358169 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] deleted object: volume_1b2c7232-baa1-4e1f-87b0-e90b753784e9/20260127003008/az_nova_backup_3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6_sha256file in container: tempest-volumesbackupsv39test-backup-container-1756897585. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 26 19:30:26.358410 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.backup.chunkeddriver [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] delete 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6 finished. {{(pid=194750) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 26 19:30:26.362399 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_db.sqlalchemy.engines [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=194750) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 26 19:30:26.381962 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.quota [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] Created reservations ['1f40eed3-2de2-4547-9f9c-d0ae60e7f8c5', '084088c9-26cb-4fa4-a2c5-5c1cb0c65d05'] {{(pid=194750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 26 19:30:26.551203 np0005596550.novalocal cinder-backup[194750]: INFO cinder.backup.manager [None req-9417b8db-8260-4e9c-8039-65423ecfc5d6 tempest-VolumesBackupsV39Test-1943903562 None] Delete backup finished, backup 3a8798ff-9c69-4f8c-bc0e-a6fc45db43d6 deleted. Jan 26 19:30:36.543421 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=38,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:31:23.771513 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:31:23.808464 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:31:23.808822 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:32:23.804203 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:32:23.804697 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:33:23.781858 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:33:23.802541 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:33:23.802898 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:34:23.802532 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:34:23.802894 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:35:23.782828 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:35:23.807104 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:35:23.807242 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:36:23.811041 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:36:23.811638 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:37:23.784188 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:37:23.816047 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:37:23.816196 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:38:23.821824 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:38:23.821824 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:39:23.784385 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:39:23.824878 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:39:23.825036 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:40:23.827821 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:40:23.828265 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:41:23.784621 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:41:23.832703 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:41:23.832847 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:42:23.837556 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:42:23.838282 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:43:23.782563 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:43:23.833117 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:43:23.833341 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:44:23.838260 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:44:23.838645 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:45:23.783455 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:45:23.842733 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:45:23.842919 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:46:23.848156 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:46:23.848747 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 26 19:47:23.787649 np0005596550.novalocal cinder-backup[194750]: DEBUG dbcounter [-] [194750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=194750) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 26 19:47:23.850912 np0005596550.novalocal cinder-backup[194750]: DEBUG oslo_service.periodic_task [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=194750) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 26 19:47:23.851087 np0005596550.novalocal cinder-backup[194750]: DEBUG cinder.manager [None req-edec4f03-4df9-4d63-9316-76e1ac98d96a None None] Notifying Schedulers of capabilities ... {{(pid=194750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}