Jan 22 10:13:09.866226 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:10.041812 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:10.042090 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:10.182040 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:10.182239 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:10.301792 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:10.420315 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:10.421025 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:10.542623 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:10.542715 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:10.690376 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:10.831332 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:10.831502 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:10.981035 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:10.981451 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:11.049236 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:11.107214 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:11.108991 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:11.188373 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:11.188497 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:11.192732 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:13:11.197156 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:13:11.197328 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:13:11.201796 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:13:11.201924 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:13:11.205348 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:13:11.205423 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1308612104, sha256file filename: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:13:11.302563 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:13:11.303260 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1308612104, metadata filename: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:13:11.354596 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "627963a7-2090-4d36-a426-26dec913365f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-63027592",\n "created_at": "2026-01-22 15:12:51+00:00",\n "objects": [\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "03ab3777-b782-4ed6-8474-a74bd8ba3cdd",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"03ab3777-b782-4ed6-8474-a74bd8ba3cdd\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:12:01.000000\\", \\"launched_at\\": \\"2026-01-22T15:12:01.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-246705244\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd 0\\", \\"provider_auth\\": \\"CHAP uonA79BDVCeeyKyW7SVK MH6GH3EEJXZfH6sr\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:12:01.000000\\", \\"updated_at\\": \\"2026-01-22T15:12:51.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:13:11.364383 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] backup 627963a7-2090-4d36-a426-26dec913365f finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:13:11.487085 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.506544 np0005592324.novalocal sudo[207578]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jan 22 10:13:11.839163 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.351s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.839867 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68', 'target_lun': 0, 'volume_id': 'cd6784e6-bdc4-432f-8375-c2548c2adc68', 'auth_method': 'CHAP', 'auth_username': 'VQmW2z4L5eudLEYPgyQc', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405fe7aefe4c64f46f097209457b', 'path': '/dev/sdc'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:13:11.840060 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:13:11.840784 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:13:11.843272 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.849875 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.850229 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3968a57-d07c-443c-81a9-a1cdc44a0c69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:11.850582 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:11.850866 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:13:11.850866 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:13:11.850866 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:13:11.851415 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:13:11.856191 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.864248 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.864248 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a802b72-ffa5-479f-8026-ea5adfaa4d24]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.864423 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.903672 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.903795 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f46b0-f36f-4bb3-9768-1893cf0574b2]: (4, ('tcp: [7] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\ntcp: [8] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd (non-flash)\ntcp: [9] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.904087 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [7] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:11.904087 np0005592324.novalocal cinder-backup[182863]: tcp: [8] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd (non-flash) Jan 22 10:13:11.904087 np0005592324.novalocal cinder-backup[182863]: tcp: [9] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 (non-flash) Jan 22 10:13:11.904087 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:11.904281 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [7] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:11.904281 np0005592324.novalocal cinder-backup[182863]: tcp: [8] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03ab3777-b782-4ed6-8474-a74bd8ba3cdd (non-flash) Jan 22 10:13:11.904281 np0005592324.novalocal cinder-backup[182863]: tcp: [9] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 (non-flash) Jan 22 10:13:11.904281 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:13:11.905335 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f30044e1300>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68'): ({'sdc'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:13:11.905680 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdc {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:13:11.906406 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.914078 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[37567b8e-2ea0-489a-898e-41bfd98a49f3]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:13:11.914768 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:13:11.915864 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37567b8e-2ea0-489a-898e-41bfd98a49f3]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.916448 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdc {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:13:11.918160 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.924286 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.924451 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcefd4bb-51d1-4348-b2c2-668a71ec5bd5]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.924817 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:13:11.930263 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.963258 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.963258 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d583fa2-13ce-4f7a-9ca2-0c4aa086f5f8]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.963366 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:13:11.963562 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdc have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:13:11.964188 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:13:11.967610 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:11.975729 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:11.975861 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a486cd0b-8a41-463d-8ac5-2d2a437bc70c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:11.977843 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:11.978433 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:12.009102 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --logout" returned: 0 in 0.030s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:12.010325 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc6d5f-976d-419e-8d93-3082d84ae9bb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68, portal: 38.102.83.245,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:12.010711 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68, portal: 38.102.83.245,3260] Jan 22 10:13:12.010711 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68, portal: 38.102.83.245,3260] successful. Jan 22 10:13:12.010711 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:12.011774 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:12.022112 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-cd6784e6-bdc4-432f-8375-c2548c2adc68 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:12.022767 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f8c067-68dd-4673-814d-710c0bfc6a68]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:12.023137 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:12.023619 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:13:12.023790 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (184ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:13:15.682135 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-a3f38a92-27be-4859-a4b0-827f113e9222 tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: 627963a7-2090-4d36-a426-26dec913365f. Jan 22 10:13:16.735356 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: 627963a7-2090-4d36-a426-26dec913365f. Jan 22 10:13:16.736740 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:13:16.736994 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:13:16.737300 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] delete started, backup: 627963a7-2090-4d36-a426-26dec913365f, container: tempest-volumesbackupstest-backup-container-1308612104, prefix: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:13:16.816763 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00001', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00002', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00003', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00004', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00005', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00006', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00007', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00008', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00009', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00010', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00011', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00012', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00013', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00014', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00015', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00016', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00017', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00018', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00019', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00020', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00021', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_metadata', 'volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:13:16.853302 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00001 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:16.886589 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00002 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:16.927600 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00003 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:16.961722 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00004 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:16.993037 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00005 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.020543 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00006 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.051579 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00007 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.085268 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00008 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.111885 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00009 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.138847 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00010 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.168251 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00011 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.191345 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00012 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.222573 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00013 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.257270 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00014 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.299916 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00015 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.330930 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00016 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.360289 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00017 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.389352 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00018 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.412980 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00019 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.441669 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00020 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.473634 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f-00021 in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.494751 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_metadata in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.522972 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_03ab3777-b782-4ed6-8474-a74bd8ba3cdd/20260122151300/az_nova_backup_627963a7-2090-4d36-a426-26dec913365f_sha256file in container: tempest-volumesbackupstest-backup-container-1308612104. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:13:17.523161 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] delete 627963a7-2090-4d36-a426-26dec913365f finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:13:17.526856 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:13:17.554875 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] Created reservations ['0c706539-573b-4cd6-bdd0-18079e5eb50e', '4f89f81f-08fd-4730-970e-568037c2017c'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:13:17.570585 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-826500e9-3e27-4e16-b012-d73bfc46f76b tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup 627963a7-2090-4d36-a426-26dec913365f deleted. Jan 22 10:13:27.570554 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:13:30.865715 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:13:30.866000 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:13:35.790591 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Create backup started, backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f volume: 9cbe3988-151d-4a2c-b10a-7f6fd5a88e66. Jan 22 10:13:35.796090 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-691705878',created_at=2026-01-22T15:13:35Z,data_timestamp=2026-01-22T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-605426591',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=3ceed502-85ba-449b-8e4f-e1c3718b612f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1178790fcc384abba0a95686179e62ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c031881c9045429093b7671291d76472',volume_id=9cbe3988-151d-4a2c-b10a-7f6fd5a88e66) Jan 22 10:13:35.823673 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:13:35.823870 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:13:35.824225 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:13:35.826765 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:35.832312 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:35.832643 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33289b6-da9b-4382-8cc9-2a827de369bc]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[367d33e4-7cc9-4729-8513-7480347efa7e]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:35.834752 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:13:35.835391 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d33e4-7cc9-4729-8513-7480347efa7e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:35.836231 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:13:35.836587 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:13:35.837594 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:35.844478 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:35.844750 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585ede5-afe3-4816-a21f-698ae5a6d33f]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:35.845524 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:35.854572 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:35.854946 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9298ab-cc00-4856-bd54-3b71d5626b3a]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:35.856223 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad278a6-19e6-478b-acef-4724882d0112]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:35.856223 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::78e1:9bff:fe57:7bb0', 'fe80::fc16:3eff:fe04:2507', 'fe80::9423:d6ff:fee3:a212', 'fe80::fc16:3eff:fecd:601b', 'fe80::fc16:3eff:fecb:7a32', 'fe80::fc16:3eff:fe28:dc9d', 'fe80::a48e:97ff:fe04:e394', 'fe80::fc16:3eff:fe61:76f0'] Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:13:35.867798 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:13:35.868237 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (42ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::78e1:9bff:fe57:7bb0', 'fe80::fc16:3eff:fe04:2507', 'fe80::9423:d6ff:fee3:a212', 'fe80::fc16:3eff:fecd:601b', 'fe80::fc16:3eff:fecb:7a32', 'fe80::fc16:3eff:fe28:dc9d', 'fe80::a48e:97ff:fe04:e394', 'fe80::fc16:3eff:fe61:76f0']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:13:39.378229 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:13:39.378229 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'target_lun': 0, 'volume_id': '9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'auth_method': 'CHAP', 'auth_username': 'WKpU5RJkZJf2RVoVVEf9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:13:39.378657 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:13:39.379385 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:13:39.379727 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'target_lun': 0, 'volume_id': '9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'auth_method': 'CHAP', 'auth_username': 'WKpU5RJkZJf2RVoVVEf9', 'auth_password': 'hLKnwYLPpKi95GG6', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:13:39.382657 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:39.390631 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[b2c7339b-f796-49b5-bd84-dc8500e44ae7]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:13:39.390938 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:13:39.392413 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c7339b-f796-49b5-bd84-dc8500e44ae7]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:39.393656 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:13:39.394412 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:13:39.394782 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:13:39.396376 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:39.406119 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260" returned: 21 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:39.406480 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[95259a08-4683-4c3d-b4c2-789c487d707e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:39.406951 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:13:39.406951 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:39.408594 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:39.416733 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:39.417241 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f128c-bea2-4a1e-8ff3-c1f11e3a5e91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:39.417600 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66] added Jan 22 10:13:39.417600 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:13:39.417600 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:13:39.417600 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:13:39.417600 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:39.417729 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:13:39.418079 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:13:39.418266 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:13:40.419668 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:13:40.420381 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.428761 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.429424 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0e1f0-9653-491a-b175-cd6820615a58]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:13:40.430195 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.433226 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.438256 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.438435 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97c31e3-a875-4ecb-b0b4-5a37e5c476c9]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.438861 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.439853 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.449321 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.449623 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61e5ae-9cb4-483c-b0db-328697008953]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.450017 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.450912 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v WKpU5RJkZJf2RVoVVEf9 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.466187 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v WKpU5RJkZJf2RVoVVEf9" returned: 0 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.466536 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e737c-5fd0-480c-b65e-2ba8dcb24c50]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.467280 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WKpU5RJkZJf2RVoVVEf9'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.469796 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.478288 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.479096 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[792991b7-8949-47e2-ac46-cf489e75cace]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.479988 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.480997 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.491448 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.491629 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1eed2-4ef2-4a39-a0bb-fb0f573e6ee5]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.491969 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:40.491969 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:40.492149 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:40.492149 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:13:40.495082 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.520489 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --login" returned: 0 in 0.024s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.520646 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[765026c2-85ec-420a-ba53-0558d8d445c5]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.521062 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260] successful. Jan 22 10:13:40.521062 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.521868 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.536509 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.537200 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2a5e3-465c-4e65-b46f-273a17f5a257]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.537385 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:40.538195 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.553878 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.554290 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d4833-a423-4145-9587-53705cfb0022]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\ntcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.554561 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:40.554561 np0005592324.novalocal cinder-backup[182863]: tcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash) Jan 22 10:13:40.554561 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:40.554756 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:40.554756 np0005592324.novalocal cinder-backup[182863]: tcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash) Jan 22 10:13:40.554756 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:13:40.555447 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:13:40.555614 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:13:40.556091 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] HCTL ('3', '-', '-', 0) found on session 11 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:13:40.556249 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:13:40.558336 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:40.581646 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.024s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:40.581794 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d08c4-7429-4f77-b9bc-1dc3d6e0182a]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:40.582773 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 11 and hctl ['3', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:13:41.584876 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 11 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:13:41.585311 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'target_lun': 0, 'volume_id': '9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'auth_method': 'CHAP', 'auth_username': 'WKpU5RJkZJf2RVoVVEf9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:13:41.585782 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.207s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:13:41.585932 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2207ms) {'type': 'block', 'scsi_wwn': '360014054c06aa3bd2574b03b1fd7ba4b', 'path': '/dev/sdb'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:13:41.588327 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:41.609800 np0005592324.novalocal sudo[208794]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 22 10:13:41.970344 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.380s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:41.978423 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:13:41.987717 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] _create_container started, container: tempest-volumesbackupstest-backup-container-691705878,backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:13:42.061961 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] generate_object_name_prefix: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:13:42.071345 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] starting backup of volume: 9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, volume size: 1073741824, object names prefix volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:13:42.444186 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:43.068346 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 19857195 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:43.068623 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:43.331488 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001: 82571f7121cb9475563edde615e4e4df {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:43.331607 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:43.457025 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:43.565662 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:43.565797 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:43.693154 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:43.695235 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:44.032327 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:44.155330 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 1362431 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:44.155769 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:44.323285 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003: a35891500449df17e893f84bd88472fb {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:44.326024 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:44.673890 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:44.789259 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:44.789259 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:44.937974 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:44.937974 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:45.573139 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:45.695614 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:45.695614 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:45.848165 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:45.848341 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:45.984512 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:46.095225 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:46.095225 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:46.217141 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:46.217319 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:46.330156 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:46.438196 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:46.438403 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:46.598307 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:46.598733 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:46.721358 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:46.862806 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:46.862932 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:46.978945 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:46.979046 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:47.098664 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:47.220155 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:47.220298 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:47.327653 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:47.327805 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:47.472476 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:47.598877 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:47.599224 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:47.719656 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:47.719798 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:47.865237 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:48.037786 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:48.037786 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:48.199977 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:48.200283 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:48.305393 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:48.401169 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:48.401469 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:48.516428 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:48.517307 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:48.652300 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:48.748553 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:48.748865 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:48.899176 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:48.899350 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:49.237406 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:49.351837 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:49.351992 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:49.483834 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:49.483953 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:49.614911 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:49.728685 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:49.729176 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:49.828991 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:49.829120 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:50.238914 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:50.401453 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:50.401513 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:50.528866 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:50.529123 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:50.678480 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:50.778285 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:50.778677 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:50.881161 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:50.881304 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:51.232098 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:51.386196 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:51.386289 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:51.563478 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:51.563478 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:51.690958 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:51.789010 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:51.789483 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:51.904249 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:51.904249 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:52.138021 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:52.294504 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:52.294504 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:52.438853 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:52.438853 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:52.513009 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:13:52.599999 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:13:52.599999 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:13:52.669527 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:13:52.670008 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:13:52.679730 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:13:52.691366 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:13:52.691951 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:13:52.699274 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:13:52.699839 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:13:52.707072 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jan 22 10:13:52.707642 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-691705878, sha256file filename: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:13:52.795051 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:13:52.795051 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-691705878, metadata filename: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:13:52.827317 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3ceed502-85ba-449b-8e4f-e1c3718b612f",\n "backup_name": "tempest-VolumesBackupsTest-Backup-605426591",\n "created_at": "2026-01-22 15:13:35+00:00",\n "objects": [\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "9cbe3988-151d-4a2c-b10a-7f6fd5a88e66",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:13:33.000000\\", \\"launched_at\\": \\"2026-01-22T15:13:35.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-246068554\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 0\\", \\"provider_auth\\": \\"CHAP WKpU5RJkZJf2RVoVVEf9 hLKnwYLPpKi95GG6\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:13:33.000000\\", \\"updated_at\\": \\"2026-01-22T15:13:37.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"os_glance_failed_import\\": \\"\\", \\"image_id\\": \\"dc40e494-7dc1-4dfa-959c-1267ce9ef86a\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:13:52.831276 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] backup 3ceed502-85ba-449b-8e4f-e1c3718b612f finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:13:52.914145 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:52.934239 np0005592324.novalocal sudo[208976]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 22 10:13:53.289352 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.373s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.289352 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'target_lun': 0, 'volume_id': '9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 'auth_method': 'CHAP', 'auth_username': 'WKpU5RJkZJf2RVoVVEf9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '360014054c06aa3bd2574b03b1fd7ba4b', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:13:53.289352 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:13:53.290044 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:13:53.291857 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.299252 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.299560 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b8e44-bb6d-4367-b57f-81ba5526b64d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:13:53.300035 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:53.300365 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:13:53.300365 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:13:53.300365 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:13:53.300873 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:13:53.301764 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.308823 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.309141 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c7b598-bfd9-4d9b-bf96-7d09675a1e72]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.310142 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.321461 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.321717 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b8b69-aa61-4ec9-b3e5-05db79897287]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\ntcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.322258 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:53.322258 np0005592324.novalocal cinder-backup[182863]: tcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash) Jan 22 10:13:53.322258 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:13:53.322535 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:13:53.322535 np0005592324.novalocal cinder-backup[182863]: tcp: [11] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 (non-flash) Jan 22 10:13:53.322535 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:13:53.323540 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f300446b7e0>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66'): ({'sdb'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:13:53.324016 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdb {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:13:53.324878 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.330265 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f4ed1717-642c-47c2-8ab6-9bcca9cdab30]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:13:53.331739 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:13:53.333194 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed1717-642c-47c2-8ab6-9bcca9cdab30]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.333896 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdb {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:13:53.334455 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.342039 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.342812 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1701c2-a65f-4cea-b07a-09e3f2b48c9c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.343308 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:13:53.344466 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.390718 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.390887 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f73f8-3935-4542-a34b-486c40e63942]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.391255 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:13:53.391497 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:13:53.391966 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:13:53.393054 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.400824 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.401007 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ac797b-3e25-4f6c-bb0e-4d0364df6c5e]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.403630 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:53.403630 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.428026 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --logout" returned: 0 in 0.026s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.428199 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9636661-f2ad-4f07-80b0-8515a02b1b2c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.428568 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260] Jan 22 10:13:53.428568 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66, portal: 38.102.83.245,3260] successful. Jan 22 10:13:53.428568 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:53.429581 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:53.444018 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:53.444250 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab144436-1967-46e1-bb79-5d3a01dbe3af]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:53.444609 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:13:53.444961 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.155s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:13:53.445190 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (156ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:13:56.979343 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-a808c652-e1d0-4fe9-8050-a1b4cdd62c1d tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f. Jan 22 10:13:58.651898 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Restore backup started, backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. Jan 22 10:13:58.658567 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:13:58.658810 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:13:58.659185 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:13:58.660976 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:58.666699 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:58.668851 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[27efb8b1-b353-4da4-adb1-90410667a191]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[765d5c8f-fbb0-4582-93e3-749d64c5425b]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:13:58.670302 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:13:58.670747 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d5c8f-fbb0-4582-93e3-749d64c5425b]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:58.671248 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:13:58.671531 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:13:58.672900 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:58.679615 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:58.679615 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a275e4c-289e-41b8-ad48-6d06c84da380]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:58.681159 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:58.690260 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:13:58.690260 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[219a9c1f-9b95-4b01-afb5-500533ec9a37]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:58.691314 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3fd916-513c-4c6b-9c20-82a66dc40e2b]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:13:58.691679 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::9423:d6ff:fee3:a212', 'fe80::fc16:3eff:fe28:dc9d', 'fe80::a48e:97ff:fe04:e394', 'fe80::fc16:3eff:feff:6d8b'] Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:13:58.704445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (44ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::9423:d6ff:fee3:a212', 'fe80::fc16:3eff:fe28:dc9d', 'fe80::a48e:97ff:fe04:e394', 'fe80::fc16:3eff:feff:6d8b']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:02.719298 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:14:02.720236 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'target_lun': 0, 'volume_id': '4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'auth_method': 'CHAP', 'auth_username': 'hKJSnccaBj47pqr3eJh6', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:02.720477 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:02.720968 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:02.721152 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'target_lun': 0, 'volume_id': '4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'auth_method': 'CHAP', 'auth_username': 'hKJSnccaBj47pqr3eJh6', 'auth_password': 'SRL4X7W65Gc3JoyT', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:14:02.722181 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:02.729095 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[c2cf280b-806b-4029-bc55-bd2ad9307d94]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:02.730505 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:02.731607 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf280b-806b-4029-bc55-bd2ad9307d94]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:02.733019 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:02.733744 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:02.734105 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:02.735271 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:02.745995 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260" returned: 21 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:02.746275 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e9479-a291-47c0-b5e5-9295686c6976]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:02.747347 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:14:02.747347 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:02.748202 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:02.758477 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:02.758687 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbc76a-f01a-4751-8c89-b8ad135521f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:02.758950 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce] added Jan 22 10:14:02.758950 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:14:02.758950 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:02.758950 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:02.758950 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:02.759099 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:14:02.759482 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:14:02.759645 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:14:03.760799 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:03.761837 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.775729 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.776004 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d87d75c-fc87-4338-b852-d468a9ac5fda]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:14:03.777826 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.781545 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.790758 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.791056 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d0001-5767-423c-bec4-395b7dd35576]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.791641 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.793242 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.800462 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.800831 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ee935-dd2e-4e8e-b7d1-a5dfc10da24f]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.801390 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.803349 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.username -v hKJSnccaBj47pqr3eJh6 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.812582 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.username -v hKJSnccaBj47pqr3eJh6" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.812932 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0339a-c9b2-4fec-97ea-d62728490d85]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.813457 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hKJSnccaBj47pqr3eJh6'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.815367 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.824589 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.824992 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b1f0f9-17a8-4f12-ae91-63244401d6b9]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.825695 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.826569 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.836953 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.837328 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b6ce3f-9d81-4570-b75c-1c6ede63d04e]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.837833 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:03.837833 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:03.838159 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:03.838159 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:03.840235 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.859637 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --login" returned: 0 in 0.017s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.859637 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c3429-d320-457e-8e7b-82532f57a568]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.859637 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260] successful. Jan 22 10:14:03.859637 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.860569 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.867626 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.867938 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8c933-1f85-4d97-8b60-71e28f6c1e1c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.868466 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:03.870297 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.881864 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.882074 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d35747-da19-4b95-85c7-0d74068648a1]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\ntcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.882593 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:03.882593 np0005592324.novalocal cinder-backup[182863]: tcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash) Jan 22 10:14:03.882593 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:03.882847 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:03.882847 np0005592324.novalocal cinder-backup[182863]: tcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash) Jan 22 10:14:03.882847 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:03.883347 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:03.883606 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:14:03.884530 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] HCTL ('3', '-', '-', 0) found on session 12 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:14:03.884840 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:14:03.885892 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:03.917159 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.031s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:03.917607 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35574e9-2d1b-4462-87d6-263021211e15]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:03.918340 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 12 and hctl ['3', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:14:04.920422 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 12 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:14:04.921386 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'target_lun': 0, 'volume_id': '4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'auth_method': 'CHAP', 'auth_username': 'hKJSnccaBj47pqr3eJh6', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:14:04.922795 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.202s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:04.923363 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2202ms) {'type': 'block', 'scsi_wwn': '36001405016b1d32548c4f918fa76b198', 'path': '/dev/sdb'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:04.924131 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:04.958793 np0005592324.novalocal sudo[209230]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 22 10:14:05.312360 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.388s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:05.312698 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] starting restore of backup volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f container: tempest-volumesbackupstest-backup-container-691705878, to new volume 4d167aff-f3e4-4dbc-8e26-c16f373cbfce, backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f. {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:783}} Jan 22 10:14:05.312866 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-691705878, metadata filename: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] _read_metadata finished. Metadata: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "backup_description": null, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "backup_id": "3ceed502-85ba-449b-8e4f-e1c3718b612f", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "backup_name": "tempest-VolumesBackupsTest-Backup-605426591", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "created_at": "2026-01-22 15:13:35+00:00", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "objects": [ Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "82571f7121cb9475563edde615e4e4df", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 0 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 52428800 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "a35891500449df17e893f84bd88472fb", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 104857600 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 157286400 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 209715200 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 262144000 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 314572800 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 367001600 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 419430400 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 471859200 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 524288000 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 576716800 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 629145600 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 681574400 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 734003200 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 786432000 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 838860800 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 891289600 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 943718400 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 996147200 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021": { Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "length": 25165824, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "offset": 1048576000 Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: ], Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "parent_id": null, Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "version": "1.0.0", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_id": "9cbe3988-151d-4a2c-b10a-7f6fd5a88e66", Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c031881c9045429093b7671291d76472\", \"project_id\": \"1178790fcc384abba0a95686179e62ac\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-22T15:13:33.000000\", \"launched_at\": \"2026-01-22T15:13:35.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-246068554\", \"display_description\": null, \"provider_location\": \"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 0\", \"provider_auth\": \"CHAP WKpU5RJkZJf2RVoVVEf9 hLKnwYLPpKi95GG6\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"d32eda9a-7ff9-443b-adbb-d3691c157d72\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"771da135-eeed-4943-b6ea-b7776ef0771a\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-22T15:13:33.000000\", \"updated_at\": \"2026-01-22T15:13:37.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.sha256\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"os_glance_importing_to_stores\": \"\", \"os_glance_failed_import\": \"\", \"image_id\": \"dc40e494-7dc1-4dfa-959c-1267ce9ef86a\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jan 22 10:14:05.432650 np0005592324.novalocal cinder-backup[182863]: }. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 22 10:14:05.437512 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Restoring backup version 1.0.0 {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:796}} Jan 22 10:14:05.437512 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-691705878, metadata filename: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] _read_metadata finished. Metadata: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "backup_description": null, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "backup_id": "3ceed502-85ba-449b-8e4f-e1c3718b612f", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "backup_name": "tempest-VolumesBackupsTest-Backup-605426591", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "created_at": "2026-01-22 15:13:35+00:00", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "objects": [ Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "82571f7121cb9475563edde615e4e4df", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 0 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 52428800 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "a35891500449df17e893f84bd88472fb", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 104857600 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 157286400 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 209715200 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 262144000 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 314572800 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 367001600 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 419430400 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 471859200 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 524288000 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 576716800 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 629145600 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 681574400 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 734003200 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 786432000 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 838860800 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 891289600 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 943718400 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 996147200 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021": { Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "length": 25165824, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "offset": 1048576000 Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: ], Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "parent_id": null, Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "version": "1.0.0", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_id": "9cbe3988-151d-4a2c-b10a-7f6fd5a88e66", Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"9cbe3988-151d-4a2c-b10a-7f6fd5a88e66\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c031881c9045429093b7671291d76472\", \"project_id\": \"1178790fcc384abba0a95686179e62ac\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-22T15:13:33.000000\", \"launched_at\": \"2026-01-22T15:13:35.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-246068554\", \"display_description\": null, \"provider_location\": \"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 iqn.2010-10.org.openstack:volume-9cbe3988-151d-4a2c-b10a-7f6fd5a88e66 0\", \"provider_auth\": \"CHAP WKpU5RJkZJf2RVoVVEf9 hLKnwYLPpKi95GG6\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"d32eda9a-7ff9-443b-adbb-d3691c157d72\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"771da135-eeed-4943-b6ea-b7776ef0771a\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-22T15:13:33.000000\", \"updated_at\": \"2026-01-22T15:13:37.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.sha256\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"os_glance_importing_to_stores\": \"\", \"os_glance_failed_import\": \"\", \"image_id\": \"dc40e494-7dc1-4dfa-959c-1267ce9ef86a\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jan 22 10:14:05.458852 np0005592324.novalocal cinder-backup[182863]: }. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 22 10:14:05.464288 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] v1 volume backup restore of 3ceed502-85ba-449b-8e4f-e1c3718b612f started. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:700}} Jan 22 10:14:05.464288 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] metadata_object_names = ['volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021']. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:707}} Jan 22 10:14:05.530773 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:14:05.535617 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:14:05.540460 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:05.661362 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:06.065596 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:06.088396 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:06.307841 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:06.328458 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:06.589472 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:06.609845 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:06.807452 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:06.831114 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:07.035030 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:07.058276 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:07.274178 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:07.294740 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:07.531338 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:07.543917 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:07.730701 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:07.748053 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:07.941589 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:07.959716 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:08.169526 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:08.190424 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:08.392079 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:08.418656 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:08.638489 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:08.656757 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:08.886132 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:08.902851 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:09.138838 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:09.164387 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:09.410335 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:09.430171 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:09.649217 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:09.662582 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:09.882649 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:09.894651 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:10.169766 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:10.183482 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:10.378974 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:10.395275 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:10.597734 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, object name: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021, volume: 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:10.615768 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:10.715350 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] v1 volume backup restore of 3ceed502-85ba-449b-8e4f-e1c3718b612f finished. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:772}} Jan 22 10:14:10.715530 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Restoring volume base metadata {{(pid=182863) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jan 22 10:14:10.726953 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] No metadata of type 'volume-metadata' to restore {{(pid=182863) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jan 22 10:14:10.727031 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Restoring volume glance metadata {{(pid=182863) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jan 22 10:14:10.799021 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] restore 3ceed502-85ba-449b-8e4f-e1c3718b612f to 4d167aff-f3e4-4dbc-8e26-c16f373cbfce finished. {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:837}} Jan 22 10:14:10.803524 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:10.830599 np0005592324.novalocal sudo[209262]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 22 10:14:11.163297 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.360s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.164845 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'target_lun': 0, 'volume_id': '4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 'auth_method': 'CHAP', 'auth_username': 'hKJSnccaBj47pqr3eJh6', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405016b1d32548c4f918fa76b198', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:11.164845 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:11.164845 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:11.165574 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.174067 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.174446 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac42422-6c07-460c-a3b3-c82184c481a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:11.174513 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:11.174686 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:14:11.174686 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:14:11.174686 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:14:11.174894 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:14:11.175582 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.182668 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.182845 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f2c8d-3a67-47cb-9373-fe219f28cfa8]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.183700 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.192837 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.193008 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ef3381-88c1-4fee-aab3-172ff0b568fc]: (4, ('tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash)\ntcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.193412 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:11.193412 np0005592324.novalocal cinder-backup[182863]: tcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash) Jan 22 10:14:11.193412 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:11.193618 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [10] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-03f9feab-6134-4796-88ea-cc7c5f4ce5f9 (non-flash) Jan 22 10:14:11.193618 np0005592324.novalocal cinder-backup[182863]: tcp: [12] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce (non-flash) Jan 22 10:14:11.193618 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:11.194298 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f3022c4f9c0>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce'): ({'sdb'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:14:11.194630 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdb {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:14:11.195706 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.202407 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fd1f403b-68ee-41e9-b14c-b6f8ed42dd1d]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:11.203341 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:11.204083 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1f403b-68ee-41e9-b14c-b6f8ed42dd1d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.204594 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdb {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:14:11.205359 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.212671 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.212796 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e6dd32-8aea-4e1f-a636-e66001781a6b]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.213046 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:14:11.213736 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.257407 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.257588 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca395a93-0a08-40a6-83f9-1258ce4dc9a3]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.257969 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:14:11.258189 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:14:11.258844 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:14:11.260295 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.270189 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.270379 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e22e478-23ab-444e-879a-01582a5c6291]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.270829 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:11.271851 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.309651 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --logout" returned: 0 in 0.037s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.309928 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e01cc4-2c97-46f0-8203-145645a7d555]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.310644 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260] Jan 22 10:14:11.310644 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce, portal: 38.102.83.245,3260] successful. Jan 22 10:14:11.310644 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:11.311835 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:11.323788 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-4d167aff-f3e4-4dbc-8e26-c16f373cbfce -p 38.102.83.245:3260 --op delete" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:11.324014 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54574bc9-67aa-4956-83e1-27e67230d937]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:11.324630 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:11.325138 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.160s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:11.325470 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (160ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:14.850698 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.manager [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Encryption key ID for volume 4d167aff-f3e4-4dbc-8e26-c16f373cbfce already matches encryption key ID in backup 3ceed502-85ba-449b-8e4f-e1c3718b612f. {{(pid=182863) _run_restore /opt/stack/cinder/cinder/backup/manager.py:874}} Jan 22 10:14:14.868581 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-b8df8a51-0633-4bfd-8b8e-ab35ecfdaa65 tempest-VolumesBackupsTest-1493266278 None] Finished restoring backup 3ceed502-85ba-449b-8e4f-e1c3718b612f to volume 4d167aff-f3e4-4dbc-8e26-c16f373cbfce. Jan 22 10:14:17.459222 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f. Jan 22 10:14:17.460298 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:14:17.460490 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:14:17.460713 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] delete started, backup: 3ceed502-85ba-449b-8e4f-e1c3718b612f, container: tempest-volumesbackupstest-backup-container-691705878, prefix: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:14:17.504825 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata', 'volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:14:17.528932 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00001 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.548683 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00002 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.571116 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00003 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.593225 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00004 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.619026 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00005 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.647177 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00006 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.674386 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00007 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.707143 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00008 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.737986 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00009 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.767198 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00010 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.796260 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00011 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.827945 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00012 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.854513 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00013 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.877186 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00014 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.900525 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00015 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.922692 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00016 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.952324 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00017 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:17.981182 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00018 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.009119 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00019 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.041154 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00020 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.076148 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f-00021 in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.118134 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_metadata in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.144270 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_9cbe3988-151d-4a2c-b10a-7f6fd5a88e66/20260122151342/az_nova_backup_3ceed502-85ba-449b-8e4f-e1c3718b612f_sha256file in container: tempest-volumesbackupstest-backup-container-691705878. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:14:18.144474 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] delete 3ceed502-85ba-449b-8e4f-e1c3718b612f finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:14:18.147111 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:14:18.157928 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] Created reservations ['a8e7bf4b-6969-4259-aa9d-486e0e37ee65', 'a979a0a4-69fd-4a37-9530-a088515c3078'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:14:18.171132 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-13bcb9b0-9ddd-40b1-9099-be7df17c2219 tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup 3ceed502-85ba-449b-8e4f-e1c3718b612f deleted. Jan 22 10:14:23.114182 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Create backup started, backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250 volume: 827bf9e8-8d8d-4ddd-aa8a-1536bcb62623. Jan 22 10:14:23.118438 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1129941640',created_at=2026-01-22T15:14:23Z,data_timestamp=2026-01-22T15:14:23Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-570580889',display_name='tempest-VolumesBackupsTest-Backup-27044325',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=1d02a726-3ba2-4b75-bb77-327f3b6e3250,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1178790fcc384abba0a95686179e62ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c031881c9045429093b7671291d76472',volume_id=827bf9e8-8d8d-4ddd-aa8a-1536bcb62623) Jan 22 10:14:23.142328 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:14:23.142485 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:14:23.142750 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:23.143731 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:23.149239 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:23.149651 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ccdfe-b418-4a92-8287-63bc27819420]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a515a8fc-009f-4de0-b772-5d489a191532]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:23.151727 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:14:23.153054 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a515a8fc-009f-4de0-b772-5d489a191532]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:23.153054 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:14:23.153054 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:14:23.153431 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:23.158976 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.005s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:23.159620 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03a5d4-4eb9-4ef3-8505-8ee96dccc659]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:23.162230 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:23.168754 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:23.168885 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba449245-1a48-45fa-8d7b-4ee8b1e52c11]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:23.169807 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b004e6-bf6f-40fd-b8cf-a5516bdc18eb]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:23.170096 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:23.182119 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:23.182299 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:14:23.183436 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:14:23.183873 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945'] Jan 22 10:14:23.183996 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:14:23.184113 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:14:23.184480 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (41ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:26.693737 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:14:26.694445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'target_lun': 0, 'volume_id': '827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'auth_method': 'CHAP', 'auth_username': 'DU3MUD7JnXgfqTDMpA5m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:26.694445 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:26.694832 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:26.694923 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'target_lun': 0, 'volume_id': '827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'auth_method': 'CHAP', 'auth_username': 'DU3MUD7JnXgfqTDMpA5m', 'auth_password': 'G3s32yenkxHsNZC8', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:14:26.695738 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:26.701935 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8fcbf878-95d7-4dde-a069-b4de780ea38a]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:26.705260 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:26.707085 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcbf878-95d7-4dde-a069-b4de780ea38a]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:26.707085 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:26.707461 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:26.707666 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:26.709059 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:26.716385 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260" returned: 21 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:26.716385 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2c23d-9d00-4101-94ab-87eb0404fc14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:26.716613 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:14:26.716613 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:26.717755 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:26.726928 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:26.727701 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9ed52-fd71-471b-8ded-55497544f4c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:26.727971 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623] added Jan 22 10:14:26.727971 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:14:26.727971 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:26.727971 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:26.727971 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:26.728128 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:14:26.728579 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.021(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:14:26.728739 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:14:27.730138 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:27.734594 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.741964 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.742961 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654a2e0-cb2a-4f54-8f6e-6093071777e2]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:14:27.744143 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.745630 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.759011 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.013s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.759124 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d3e78b-c2cb-47d0-b14a-9cb8b7c96fa6]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.759417 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.763134 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.772410 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.772523 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0ee42-5de9-4d7f-bfd8-addf876c8a77]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.772820 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.776218 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v DU3MUD7JnXgfqTDMpA5m {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.785161 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v DU3MUD7JnXgfqTDMpA5m" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.786190 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffcf296-1836-484b-a58c-194aab74c480]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.786573 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DU3MUD7JnXgfqTDMpA5m'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.789551 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.803024 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.803153 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a07cde-c160-49a8-8132-3afed2df2c0c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.803980 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.805176 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.815198 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.815729 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c77938-f7b5-4959-a346-6b828c25c2a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.815981 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 22 10:14:27.815981 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:27.816109 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 22 10:14:27.816109 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:27.816452 np0005592324.novalocal cinder-backup[182863]: WARNING os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 22 10:14:27.816452 np0005592324.novalocal cinder-backup[182863]: Jan 22 10:14:27.818427 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.836095 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --login" returned: 0 in 0.018s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.836095 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93ff42a-9c88-42b2-9ced-2b3144ea1d3a]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.836818 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260] successful. Jan 22 10:14:27.836818 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.837786 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.854539 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.854772 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8aa816-1185-471d-8d75-30a6a50ca1e2]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.855120 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:27.857438 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.866349 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.866481 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd4eda-66a7-490d-a97f-b5a98c78a0fa]: (4, ('tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash) Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash) Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] HCTL ('2', '-', '-', 0) found on session 13 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:14:27.868720 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:27.885509 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.017s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:27.885630 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[284de65f-f662-497c-89d0-b7f6f11e0b5a]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:27.888890 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 13 and hctl ['2', '*', '*', 0] yield: sda {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:14:27.889317 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'target_lun': 0, 'volume_id': '827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'auth_method': 'CHAP', 'auth_username': 'DU3MUD7JnXgfqTDMpA5m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:14:28.890744 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.196s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:28.891123 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2196ms) {'type': 'block', 'scsi_wwn': '3600140578848ec65dfc458c9805a9326', 'path': '/dev/sda'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:28.891235 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:28.915136 np0005592324.novalocal sudo[209899]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 22 10:14:29.239866 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.347s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:29.250640 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:14:29.253456 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=98,cinder:UPDATE=18,cinder:INSERT=17 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:14:29.260242 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1129941640,backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:14:29.335636 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] generate_object_name_prefix: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250 {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:14:29.339797 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] starting backup of volume: 827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, volume size: 1073741824, object names prefix volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:14:29.474952 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:29.605303 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:29.605434 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:29.751123 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:29.751278 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:29.876643 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:29.989694 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:29.990048 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:30.122387 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:30.122514 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:30.261340 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:30.407677 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:30.407677 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:30.549792 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:30.549946 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:30.738702 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:30.869356 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:14:30.869518 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:14:30.902979 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:30.903194 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:31.022611 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:31.022870 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:31.170149 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:31.302412 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:31.302412 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:31.422779 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:31.422916 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:31.540032 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:31.697132 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:31.700923 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:31.835539 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:31.835698 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:32.243026 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:32.361172 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:32.361513 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:32.493801 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:32.493937 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:32.634663 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:32.736850 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:32.736850 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:32.878994 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:32.878994 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:33.011164 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:33.126451 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:33.126582 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:33.257981 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:33.258386 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:33.627929 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:33.781753 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:33.781753 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:33.932314 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:33.932425 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:34.047501 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:34.201737 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:34.201897 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:34.318897 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:34.319307 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:34.451956 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:34.572361 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:34.572491 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:34.703541 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:34.703678 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:34.845619 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:34.995864 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:34.995864 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:35.121389 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:35.121581 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:35.316706 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:35.473646 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:35.473646 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:35.595279 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:35.595394 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:35.747842 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:35.871524 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:35.871651 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:36.031151 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:36.031368 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:36.400426 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:36.577141 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:36.577550 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:36.706237 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:36.706369 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:36.905564 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:37.004574 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:37.004574 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:37.141818 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:37.141937 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:37.284052 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:37.406427 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:37.406706 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:37.518716 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:37.519260 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:37.628068 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:37.732198 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:37.732198 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:37.870009 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:37.870134 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:38.034412 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:38.142814 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:38.142940 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:38.258415 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:38.258565 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:38.518770 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:14:38.589333 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:14:38.589602 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:14:38.668747 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:14:38.669115 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:14:38.679427 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:14:38.687644 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:14:38.687880 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:14:38.691356 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jan 22 10:14:38.691471 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:14:38.694313 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:14:38.694624 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1129941640, sha256file filename: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:14:38.759052 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:14:38.759546 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1129941640, metadata filename: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:14:38.796210 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-570580889",\n "backup_id": "1d02a726-3ba2-4b75-bb77-327f3b6e3250",\n "backup_name": "tempest-VolumesBackupsTest-Backup-27044325",\n "created_at": "2026-01-22 15:14:23+00:00",\n "objects": [\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "827bf9e8-8d8d-4ddd-aa8a-1536bcb62623",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:14:22.000000\\", \\"launched_at\\": \\"2026-01-22T15:14:22.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1476082605\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 0\\", \\"provider_auth\\": \\"CHAP DU3MUD7JnXgfqTDMpA5m G3s32yenkxHsNZC8\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:14:21.000000\\", \\"updated_at\\": \\"2026-01-22T15:14:25.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:14:38.799397 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] backup 1d02a726-3ba2-4b75-bb77-327f3b6e3250 finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:14:38.864582 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:38.887351 np0005592324.novalocal sudo[210000]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 22 10:14:39.238866 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.374s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.239344 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'target_lun': 0, 'volume_id': '827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 'auth_method': 'CHAP', 'auth_username': 'DU3MUD7JnXgfqTDMpA5m', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3600140578848ec65dfc458c9805a9326', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:39.239344 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:39.241954 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:39.242926 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.252691 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.252809 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca22c0-de38-41cf-9701-38a6f093e310]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:39.253020 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:39.253159 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:14:39.253159 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:14:39.253159 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:14:39.253478 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:14:39.254207 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.264021 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.267454 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dc4971-9dc2-4950-9073-53bd34494ff7]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.268716 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.282512 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.282729 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84a0b8a-253f-4cf7-b02c-8cba797fd966]: (4, ('tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.283119 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash) Jan 22 10:14:39.283119 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:39.283345 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [13] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 (non-flash) Jan 22 10:14:39.283345 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:39.284044 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f30045091c0>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623'): ({'sda'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:14:39.284338 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sda {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:14:39.285194 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.290776 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e6a00de0-b068-4001-b5ac-344206d70950]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:39.291850 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:39.294654 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a00de0-b068-4001-b5ac-344206d70950]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.295190 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sda {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:14:39.298943 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.303240 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.303840 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd91e2-cf44-43e8-8ae1-26a62e2bb8d9]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.304349 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:14:39.305253 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.379977 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.074s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.380146 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d750b92-83fe-4f21-a315-90aa9b39104f]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.381863 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:14:39.381863 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:14:39.381863 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:14:39.383465 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.391163 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.391713 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b8ba44-2224-41c9-83b5-5e583342bd38]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.391965 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:39.392661 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.420465 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --logout" returned: 0 in 0.027s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.420882 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[840aca38-46f3-4d99-b4b6-3d1a9da28fe1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.420882 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260] Jan 22 10:14:39.420882 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623, portal: 38.102.83.245,3260] successful. Jan 22 10:14:39.420882 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:39.424393 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:39.429692 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:39.430126 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a03e2-19b3-48d8-9f92-a18418601ec1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:39.430508 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:39.430725 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.189s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:39.430857 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (192ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:42.952248 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-556e2ca8-4d56-4266-ab8c-fafdef996ba9 tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250. Jan 22 10:14:44.969743 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Restore backup started, backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250 volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. Jan 22 10:14:44.981108 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:14:44.981251 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:14:44.981488 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:44.982582 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:44.988854 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:44.989028 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d652bb-2c76-4aa8-80bb-38c45cdda55e]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f57ecadd-1846-4974-8668-3793fdd2df37]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:14:44.991012 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ecadd-1846-4974-8668-3793fdd2df37]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:44.992639 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:14:44.992639 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:14:44.992639 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:45.007621 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:45.008574 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14221ac3-0fe5-458a-8879-071cbecf831c]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:45.009390 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:45.018385 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:45.018519 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[743aa79b-9f7b-4eb2-a6ae-497f908665d9]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:45.019149 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639e73f-cbfc-4a7d-8f21-70899abc9b4e]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:45.019449 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:45.031769 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:45.032005 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:14:45.033483 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:14:45.034009 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee2:8f35', 'fe80::1805:14ff:fecd:4634'] Jan 22 10:14:45.034135 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:14:45.034270 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:14:45.034499 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee2:8f35', 'fe80::1805:14ff:fecd:4634']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:49.046169 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:14:49.046785 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'target_lun': 0, 'volume_id': '76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'auth_method': 'CHAP', 'auth_username': 'pzaUdPtGnAP2CNABFBU9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:49.046936 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:49.047274 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:49.047415 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'target_lun': 0, 'volume_id': '76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'auth_method': 'CHAP', 'auth_username': 'pzaUdPtGnAP2CNABFBU9', 'auth_password': 'H5DjT2Beh4j5DUdr', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:14:49.048047 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:49.054619 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[35fd823e-77a2-4994-acea-2454e5e19ea0]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:49.056586 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:49.057302 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fd823e-77a2-4994-acea-2454e5e19ea0]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:49.057766 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:49.058116 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:49.058299 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:49.058873 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:49.067389 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260" returned: 21 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:49.067866 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[146212e4-c1d3-4ef7-9e07-94a613c46577]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:49.068102 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:14:49.068102 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:49.069254 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:49.075605 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:49.075728 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b72d0-de18-419b-ab98-a6a45ce84d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:49.076011 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10] added Jan 22 10:14:49.076011 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:14:49.076011 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:49.076011 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:14:49.076011 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:49.076148 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:14:49.076545 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.018(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:14:49.076963 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:14:50.078154 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:14:50.078900 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.090581 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.090740 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054ade0-c817-4af5-b557-36542bfd5936]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:14:50.091560 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.096276 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.101450 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.101550 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94447a-b644-4bc2-93d5-93b35e9e5a5f]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.101812 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.102539 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.114482 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.114619 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47ba12c-0ba3-4923-85fa-b668edbe774d]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.116140 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.117411 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v pzaUdPtGnAP2CNABFBU9 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.130548 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v pzaUdPtGnAP2CNABFBU9" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.130701 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db211405-10b9-4f91-bfff-abab124b518b]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.130977 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzaUdPtGnAP2CNABFBU9'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.132108 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.145541 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.145541 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0525ca5-99a0-40a5-b1a9-3c16a027df8e]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.145541 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.146162 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.154823 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.154987 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad334317-b997-44f9-b35d-6f181368043a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.155259 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 22 10:14:50.155259 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:50.155393 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 22 10:14:50.155393 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:50.155551 np0005592324.novalocal cinder-backup[182863]: WARNING os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 22 10:14:50.155551 np0005592324.novalocal cinder-backup[182863]: Jan 22 10:14:50.157150 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.175972 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --login" returned: 0 in 0.018s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.176091 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e6f4f3-55d3-4be5-8aa2-bfc0bec79dba]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.176384 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260] successful. Jan 22 10:14:50.176384 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.176901 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.185818 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.185999 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de58c4-2f8e-42a3-ba4e-f43a9cb8354c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.186350 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:50.187787 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.197290 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.197484 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7996b-0964-462a-a8d7-37a2c5f817ad]: (4, ('tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.197789 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash) Jan 22 10:14:50.197789 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:50.197917 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash) Jan 22 10:14:50.197917 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:50.198190 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:50.198336 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:14:50.198750 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] HCTL ('2', '-', '-', 0) found on session 14 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:14:50.198875 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:14:50.200427 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:50.219767 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.019s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:50.219868 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aeed3d-bcd0-4aa4-82b7-246ca93c24b4]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:50.220403 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 14 and hctl ['2', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:14:51.221962 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 14 and hctl ['2', '*', '*', 0] yield: sda {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:14:51.222577 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'target_lun': 0, 'volume_id': '76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'auth_method': 'CHAP', 'auth_username': 'pzaUdPtGnAP2CNABFBU9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:14:51.223433 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.176s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:51.223717 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2176ms) {'type': 'block', 'scsi_wwn': '36001405f70b05c02ce0468684f2ddae9', 'path': '/dev/sda'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:14:51.224175 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:51.251608 np0005592324.novalocal sudo[210442]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 22 10:14:51.608333 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.384s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:51.608793 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] starting restore of backup volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250 container: tempest-volumesbackupstest-backup-container-1129941640, to new volume 76ed19d5-0e2b-4478-b4c2-51b9556acd10, backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250. {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:783}} Jan 22 10:14:51.609013 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1129941640, metadata filename: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] _read_metadata finished. Metadata: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "backup_description": "tempest-backup-description-570580889", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "backup_id": "1d02a726-3ba2-4b75-bb77-327f3b6e3250", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "backup_name": "tempest-VolumesBackupsTest-Backup-27044325", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "created_at": "2026-01-22 15:14:23+00:00", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "objects": [ Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 0 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 52428800 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 104857600 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 157286400 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 209715200 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 262144000 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 314572800 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 367001600 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 419430400 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 471859200 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 524288000 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 576716800 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 629145600 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 681574400 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 734003200 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 786432000 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 838860800 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 891289600 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 943718400 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 996147200 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021": { Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "length": 25165824, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "offset": 1048576000 Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: ], Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "parent_id": null, Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "version": "1.0.0", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_id": "827bf9e8-8d8d-4ddd-aa8a-1536bcb62623", Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c031881c9045429093b7671291d76472\", \"project_id\": \"1178790fcc384abba0a95686179e62ac\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-22T15:14:22.000000\", \"launched_at\": \"2026-01-22T15:14:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1476082605\", \"display_description\": null, \"provider_location\": \"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 0\", \"provider_auth\": \"CHAP DU3MUD7JnXgfqTDMpA5m G3s32yenkxHsNZC8\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"d32eda9a-7ff9-443b-adbb-d3691c157d72\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"771da135-eeed-4943-b6ea-b7776ef0771a\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-22T15:14:21.000000\", \"updated_at\": \"2026-01-22T15:14:25.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jan 22 10:14:51.633987 np0005592324.novalocal cinder-backup[182863]: }. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 22 10:14:51.636063 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Restoring backup version 1.0.0 {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:796}} Jan 22 10:14:51.636063 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1129941640, metadata filename: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:323}} Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] _read_metadata finished. Metadata: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "backup_description": "tempest-backup-description-570580889", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "backup_id": "1d02a726-3ba2-4b75-bb77-327f3b6e3250", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "backup_name": "tempest-VolumesBackupsTest-Backup-27044325", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "created_at": "2026-01-22 15:14:23+00:00", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "objects": [ Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 0 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 52428800 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 104857600 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 157286400 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 209715200 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 262144000 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 314572800 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 367001600 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 419430400 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 471859200 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 524288000 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 576716800 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 629145600 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 681574400 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 734003200 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 786432000 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 838860800 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 891289600 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 943718400 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 52428800, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "25e317773f308e446cc84c503a6d1f85", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 996147200 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021": { Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "compression": "zlib", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "length": 25165824, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "offset": 1048576000 Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: } Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: ], Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "parent_id": null, Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "version": "1.0.0", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_id": "827bf9e8-8d8d-4ddd-aa8a-1536bcb62623", Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"827bf9e8-8d8d-4ddd-aa8a-1536bcb62623\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c031881c9045429093b7671291d76472\", \"project_id\": \"1178790fcc384abba0a95686179e62ac\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-01-22T15:14:22.000000\", \"launched_at\": \"2026-01-22T15:14:22.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1476082605\", \"display_description\": null, \"provider_location\": \"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 iqn.2010-10.org.openstack:volume-827bf9e8-8d8d-4ddd-aa8a-1536bcb62623 0\", \"provider_auth\": \"CHAP DU3MUD7JnXgfqTDMpA5m G3s32yenkxHsNZC8\", \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"d32eda9a-7ff9-443b-adbb-d3691c157d72\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"771da135-eeed-4943-b6ea-b7776ef0771a\", \"shared_targets\": false, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-01-22T15:14:21.000000\", \"updated_at\": \"2026-01-22T15:14:25.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jan 22 10:14:51.656828 np0005592324.novalocal cinder-backup[182863]: }. {{(pid=182863) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:330}} Jan 22 10:14:51.659066 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] v1 volume backup restore of 1d02a726-3ba2-4b75-bb77-327f3b6e3250 started. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:700}} Jan 22 10:14:51.659066 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] metadata_object_names = ['volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021']. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:707}} Jan 22 10:14:51.720806 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:14:51.726180 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:14:51.732521 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:51.750274 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:51.984022 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:52.003345 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:52.266078 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:52.293243 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:52.504619 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:52.519528 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:52.741368 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:52.761669 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:52.965693 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:52.982623 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:53.196037 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:53.211189 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:53.409418 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:53.450928 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:53.653178 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:53.671197 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:53.919238 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:53.941829 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:54.243125 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:54.264950 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:54.455567 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:54.473825 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:54.686642 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:54.701001 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:54.952217 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:54.967657 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:55.162294 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:55.179391 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:55.438143 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:55.454844 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:55.638858 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:55.653352 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:55.878835 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:55.898516 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:56.149885 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:56.166323 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:56.355608 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:56.370154 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:56.608392 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restoring object. backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, object name: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021, volume: 76ed19d5-0e2b-4478-b4c2-51b9556acd10. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:727}} Jan 22 10:14:56.621474 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] decompressing data using zlib algorithm {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:744}} Jan 22 10:14:56.715178 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] v1 volume backup restore of 1d02a726-3ba2-4b75-bb77-327f3b6e3250 finished. {{(pid=182863) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:772}} Jan 22 10:14:56.715553 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Restoring volume base metadata {{(pid=182863) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jan 22 10:14:56.724190 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Restoring volume metadata {{(pid=182863) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jan 22 10:14:56.729619 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=182863) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jan 22 10:14:56.729737 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] restore 1d02a726-3ba2-4b75-bb77-327f3b6e3250 to 76ed19d5-0e2b-4478-b4c2-51b9556acd10 finished. {{(pid=182863) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:837}} Jan 22 10:14:56.730261 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:56.756823 np0005592324.novalocal sudo[210549]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 22 10:14:57.098778 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.368s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.100951 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'target_lun': 0, 'volume_id': '76ed19d5-0e2b-4478-b4c2-51b9556acd10', 'auth_method': 'CHAP', 'auth_username': 'pzaUdPtGnAP2CNABFBU9', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405f70b05c02ce0468684f2ddae9', 'path': '/dev/sda'}), 'kwargs': {'force': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:14:57.101122 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:14:57.101529 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:14:57.103800 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.110934 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.111711 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acea29-d196-4945-a79e-b80033218355]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:14:57.112012 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:57.112156 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:14:57.112156 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:14:57.112156 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:14:57.112471 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:14:57.113592 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.121408 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.121546 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79656b-f75e-4b4d-bbfb-1b6fd86e9dd8]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.124409 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.131495 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.131615 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68702e2c-6089-43ba-b98f-93e58faeb546]: (4, ('tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.131900 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash) Jan 22 10:14:57.131900 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:14:57.132050 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [14] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 (non-flash) Jan 22 10:14:57.132050 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:14:57.132537 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f300446a840>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10'): ({'sda'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:14:57.132726 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sda {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:14:57.133421 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.139029 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e27fe2ff-ab43-44cc-a1a8-7cc981bd047c]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:14:57.141247 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:14:57.142105 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27fe2ff-ab43-44cc-a1a8-7cc981bd047c]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.142629 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sda {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:14:57.143524 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.149139 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.149432 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4c59c-741c-4dc0-98ed-6b2b84ce8d51]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.151081 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:14:57.151081 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.187650 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.036s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.187830 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73104e19-28f0-41ed-9674-f971b4a92067]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.188019 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:14:57.188157 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:14:57.188372 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:14:57.190433 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.197669 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.198105 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaaf337-f8ab-4492-9b20-07d3664921a7]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.198629 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:57.199389 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.222991 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --logout" returned: 0 in 0.024s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.222991 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91019a-ea8f-4cd6-a79a-b137854af6dd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.223292 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260] Jan 22 10:14:57.223292 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10, portal: 38.102.83.245,3260] successful. Jan 22 10:14:57.223292 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:57.225549 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:14:57.232865 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-76ed19d5-0e2b-4478-b4c2-51b9556acd10 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:14:57.233023 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea282ef0-7f8e-4951-8113-14fe321acc57]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:14:57.234699 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:14:57.234699 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.132s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:14:57.234699 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (133ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:15:00.763413 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.manager [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Encryption key ID for volume 76ed19d5-0e2b-4478-b4c2-51b9556acd10 already matches encryption key ID in backup 1d02a726-3ba2-4b75-bb77-327f3b6e3250. {{(pid=182863) _run_restore /opt/stack/cinder/cinder/backup/manager.py:874}} Jan 22 10:15:00.785910 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-100a8aa6-a798-42b1-a823-c546837b05a1 tempest-VolumesBackupsTest-1493266278 None] Finished restoring backup 1d02a726-3ba2-4b75-bb77-327f3b6e3250 to volume 76ed19d5-0e2b-4478-b4c2-51b9556acd10. Jan 22 10:15:03.745436 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250. Jan 22 10:15:03.746723 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:15:03.747095 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:15:03.747728 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] delete started, backup: 1d02a726-3ba2-4b75-bb77-327f3b6e3250, container: tempest-volumesbackupstest-backup-container-1129941640, prefix: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:15:03.825913 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata', 'volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:15:03.862288 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00001 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:03.891595 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00002 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:03.925919 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00003 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:03.961237 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00004 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:03.998549 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00005 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.031258 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00006 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.058259 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00007 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.082559 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00008 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.112301 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00009 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.136649 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00010 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.166087 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00011 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.197890 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00012 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.224281 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00013 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.254247 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00014 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.284578 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00015 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.320812 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00016 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.357896 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00017 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.396905 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00018 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.422267 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00019 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.450421 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00020 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.493782 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250-00021 in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.517163 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_metadata in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.541367 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_827bf9e8-8d8d-4ddd-aa8a-1536bcb62623/20260122151429/az_nova_backup_1d02a726-3ba2-4b75-bb77-327f3b6e3250_sha256file in container: tempest-volumesbackupstest-backup-container-1129941640. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:15:04.541367 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] delete 1d02a726-3ba2-4b75-bb77-327f3b6e3250 finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:15:04.542937 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:15:04.554896 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] Created reservations ['4b0e2a45-2fb1-453d-8db6-f23d9a8663a9', 'fe99ab38-cccb-4e62-a403-f0cbd3ff5fe6'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:15:04.567040 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-fdba201b-f11a-4572-a536-5316f81e52b0 tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup 1d02a726-3ba2-4b75-bb77-327f3b6e3250 deleted. Jan 22 10:15:14.567604 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:UPDATE=14,cinder:SELECT=65,cinder:INSERT=4 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:15:30.875840 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:15:30.876361 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:16:00.362091 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Create backup started, backup: 29467ca2-7202-4806-ba56-4fcd07b80a13 volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0. Jan 22 10:16:00.365065 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1567908794',created_at=2026-01-22T15:16:00Z,data_timestamp=2026-01-22T15:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-336980486',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=29467ca2-7202-4806-ba56-4fcd07b80a13,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1178790fcc384abba0a95686179e62ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c031881c9045429093b7671291d76472',volume_id=650b26c3-82c3-4591-8e3b-0cdf389cd2c0) Jan 22 10:16:01.698937 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:16:01.699322 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:16:01.699439 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:01.702735 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:01.708912 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:01.708912 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0487c6-dc09-4690-8adb-ad57ce5a4bdb]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e8174eea-daf0-4810-b7a0-7bdf02b828b8]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:01.711092 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:16:01.711465 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8174eea-daf0-4810-b7a0-7bdf02b828b8]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:01.711832 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:16:01.712082 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:16:01.712905 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:01.719836 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:01.720056 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13de3b0-1bc9-4d2f-a7c6-dbc6cb5f3a31]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:01.720848 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:01.729456 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:01.729456 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7ccb7f-47e6-4465-96d8-146e8f89cad1]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:01.730026 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e00b299-6f37-499b-8689-112d252e9135]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:01.730469 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:01.742846 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:01.743093 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:16:01.744519 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:16:01.745424 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::940c:cfff:fe01:97c7'] Jan 22 10:16:01.745604 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:16:01.745776 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:16:01.746166 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (46ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::940c:cfff:fe01:97c7']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:05.256330 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:16:05.256330 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'target_lun': 0, 'volume_id': '156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'auth_method': 'CHAP', 'auth_username': 'MZnRi2JEqfADYXoEEQrm', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:05.256330 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:05.256330 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:05.256330 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'target_lun': 0, 'volume_id': '156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'auth_method': 'CHAP', 'auth_username': 'MZnRi2JEqfADYXoEEQrm', 'auth_password': 'FcGisoAGGX3bCd7r', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:16:05.257034 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:05.263909 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fa9af675-611e-480b-a517-75960d0ea622]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:05.266523 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:05.266810 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9af675-611e-480b-a517-75960d0ea622]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:05.267277 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:05.267743 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:05.268007 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:05.270784 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:05.278450 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260" returned: 21 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:05.278976 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9d44ba-c237-4b53-9b32-02d17cf4d453]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:05.279327 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:16:05.279327 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:05.280816 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:05.289217 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:05.289611 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe934a9-71fc-47dc-8a3c-589f3c48288e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:05.289896 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b] added Jan 22 10:16:05.289896 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:16:05.289896 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:05.289896 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:05.289896 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:05.290192 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:16:05.290669 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:16:05.290903 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:16:06.292699 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:06.294070 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.302732 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.302840 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e00e56-e178-4132-bdd5-0d2fbe696e4b]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:16:06.303859 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.307266 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.311807 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.311990 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa765fe-517a-426d-8fe9-a45c6825fd54]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.312384 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.315618 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.323162 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.324000 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafcbd8b-7e16-4502-bc56-33ffcd691a6b]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.324429 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.325155 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.username -v MZnRi2JEqfADYXoEEQrm {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.331540 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.username -v MZnRi2JEqfADYXoEEQrm" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.332270 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e95c0b-1449-4358-a7e0-29cd31c0f0c4]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.332270 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZnRi2JEqfADYXoEEQrm'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.334777 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.345299 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.345299 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03add3-20f1-4297-9603-98ec24ffe20a]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.345720 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.346709 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.355237 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.355421 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa8f29-ad3c-4358-81c6-ca7b0a62a53d]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.355834 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:06.355834 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:06.356056 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:06.356056 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:06.357174 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.373697 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --login" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.373697 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6184d-2ec1-45bb-a91a-6da40add02a4]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.373697 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260] successful. Jan 22 10:16:06.373697 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.375652 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.385423 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.385423 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848e742-5ac9-4bfa-badb-cc08236bfb14]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.385423 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:06.385771 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.395699 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.395699 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc81ec1-efbb-4f71-8392-5c084dbce993]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.396176 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:06.396176 np0005592324.novalocal cinder-backup[182863]: tcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash) Jan 22 10:16:06.396176 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:06.396618 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:06.396618 np0005592324.novalocal cinder-backup[182863]: tcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash) Jan 22 10:16:06.396618 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:06.397164 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:06.397737 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:16:06.398178 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] HCTL ('3', '-', '-', 0) found on session 16 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:16:06.398516 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:16:06.399442 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:06.418914 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.018s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:06.418914 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c208b332-a2a7-4fd2-8b17-9f14946e65a2]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:06.418914 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 16 and hctl ['3', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:07.421603 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 16 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:07.422373 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'target_lun': 0, 'volume_id': '156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'auth_method': 'CHAP', 'auth_username': 'MZnRi2JEqfADYXoEEQrm', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:16:07.423474 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.168s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:07.423956 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2168ms) {'type': 'block', 'scsi_wwn': '36001405b6f79f3e094540089abce38e2', 'path': '/dev/sdb'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:07.424828 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:07.447349 np0005592324.novalocal sudo[212058]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 22 10:16:07.777135 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.352s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:07.783620 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:16:07.789282 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1567908794,backup: 29467ca2-7202-4806-ba56-4fcd07b80a13. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:16:07.867696 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] generate_object_name_prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13 {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:16:07.874237 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] starting backup of volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0, volume size: 1073741824, object names prefix volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:16:08.022390 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:08.174675 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:08.175069 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:08.316818 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:08.320222 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:08.682520 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:08.787670 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:08.787991 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:08.895527 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:08.895714 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:09.064779 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:09.174357 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:09.174527 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:09.283594 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:09.283854 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:09.405904 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:09.529575 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:09.529730 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:09.645270 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:09.645438 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:10.017122 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:10.224840 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:10.224840 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:10.353654 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:10.353654 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:10.691743 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:10.843338 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:10.843451 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:10.964734 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:10.965034 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:11.343866 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:11.465683 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:11.465683 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:11.590285 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:11.590285 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:11.730116 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:11.837971 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:11.837971 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:11.953637 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:11.953637 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:12.315304 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:12.432867 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:12.432867 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:12.555924 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:12.555924 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:12.919728 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:13.034846 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:13.034846 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:13.163088 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:13.163088 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:13.712559 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:13.860026 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:13.860026 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:13.973607 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:13.973607 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:14.140241 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:14.243856 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:14.244127 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:14.347213 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:14.347213 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:14.510931 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:14.648680 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:14.648798 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:14.762838 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:14.763255 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:14.913810 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:15.064847 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:15.065043 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:15.253245 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:15.253436 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:15.374880 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:15.473432 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:15.473615 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:15.581755 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:15.582013 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:15.828373 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:15.956183 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:15.956489 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:16.090415 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:16.090605 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:16.212777 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:16.373606 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:16.373743 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:16.491628 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:16.491812 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:16.593997 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:16.693147 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:16.693475 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:16.800493 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:16.800680 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:16.905498 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:17.041861 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:17.042006 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:17.155394 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:17.155504 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:17.259458 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:17.354004 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:17.354124 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:17.463829 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:17.464021 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:17.544546 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:16:17.603989 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:16:17.604158 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:16:17.678784 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup MD5 for volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:16:17.678784 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:16:17.684675 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:16:17.696277 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:16:17.696469 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:16:17.700256 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:16:17.700340 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:16:17.705943 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:16:17.706245 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1567908794, sha256file filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:16:17.789883 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:16:17.790505 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1567908794, metadata filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:16:17.821172 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "29467ca2-7202-4806-ba56-4fcd07b80a13",\n "backup_name": "tempest-VolumesBackupsTest-Backup-336980486",\n "created_at": "2026-01-22 15:16:00+00:00",\n "objects": [\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "650b26c3-82c3-4591-8e3b-0cdf389cd2c0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"650b26c3-82c3-4591-8e3b-0cdf389cd2c0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:15:07.000000\\", \\"launched_at\\": \\"2026-01-22T15:15:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1220743166\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 0\\", \\"provider_auth\\": \\"CHAP MbTqP7Rn67MxU59SR5C6 Uxd2UDMa6952GPyJ\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:15:07.000000\\", \\"updated_at\\": \\"2026-01-22T15:16:00.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:16:17.824121 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] backup 29467ca2-7202-4806-ba56-4fcd07b80a13 finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:16:17.909263 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:17.930836 np0005592324.novalocal sudo[212212]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 22 10:16:18.239268 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.331s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.242188 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'target_lun': 0, 'volume_id': '156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 'auth_method': 'CHAP', 'auth_username': 'MZnRi2JEqfADYXoEEQrm', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405b6f79f3e094540089abce38e2', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:18.244664 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:18.245002 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:18.247995 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.253301 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.253492 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ce37a-60c6-4d67-ae59-df8a30eb7aff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:18.253735 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:18.253906 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:16:18.253906 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:16:18.253906 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:16:18.254111 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:16:18.257083 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.264830 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.265015 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06866b16-5e93-4899-8554-d3fb28ad9409]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.267944 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.272148 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.272345 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00598427-ee49-4e86-bd54-ed0df1b99561]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.272660 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:18.272660 np0005592324.novalocal cinder-backup[182863]: tcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash) Jan 22 10:16:18.272660 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:18.272850 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:18.272850 np0005592324.novalocal cinder-backup[182863]: tcp: [16] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b (non-flash) Jan 22 10:16:18.272850 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:18.277573 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f3004508720>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b'): ({'sdb'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:16:18.277771 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdb {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:16:18.278593 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.283679 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[07689eef-8c0f-40ff-ab86-5b567588c0bd]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:18.285551 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:18.287228 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07689eef-8c0f-40ff-ab86-5b567588c0bd]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.287530 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdb {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:16:18.289401 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.292281 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.004s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.292404 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1af54c2-2c28-4e3d-950c-49a3060ce4fb]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.292591 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:16:18.293334 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.351257 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.351978 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b15c8-94ea-4a21-bbcc-d7779a0a7653]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.351978 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:16:18.351978 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:16:18.352175 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:16:18.354840 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.371645 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.371645 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b0d5d0-b034-4eab-9767-42b3748bb2ea]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.372079 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:18.373627 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.405149 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --logout" returned: 0 in 0.031s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.406034 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b544ab51-036c-40c4-ac91-04c515ba416f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.406711 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260] Jan 22 10:16:18.406711 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b, portal: 38.102.83.245,3260] successful. Jan 22 10:16:18.406711 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:18.407700 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:18.416928 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-156defd3-4cb4-42bd-b6a3-9b4f5a6ba81b -p 38.102.83.245:3260 --op delete" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:18.417918 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3eae10-b189-4ae2-ac83-29eb2f7ca18f]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:18.417918 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:18.419037 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.173s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:18.419037 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (175ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:21.960376 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-db591170-18ce-47ac-80b3-8d1e13e9e75a tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: 29467ca2-7202-4806-ba56-4fcd07b80a13. Jan 22 10:16:23.156352 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Create backup started, backup: b04181a5-7827-484f-b8e1-e66f0185b4f1 volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0. Jan 22 10:16:23.161327 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-01-22T15:16:23Z,data_timestamp=2026-01-22T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=b04181a5-7827-484f-b8e1-e66f0185b4f1,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(29467ca2-7202-4806-ba56-4fcd07b80a13),parent_id='29467ca2-7202-4806-ba56-4fcd07b80a13',project_id='1178790fcc384abba0a95686179e62ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c031881c9045429093b7671291d76472',volume_id=650b26c3-82c3-4591-8e3b-0cdf389cd2c0) Jan 22 10:16:24.493480 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:16:24.493975 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:16:24.493975 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:24.495276 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:24.503824 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:24.503982 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abba930-579d-4d40-a46e-e5734e021842]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[fd705892-0eeb-4ec5-b253-441a7b36158d]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:24.505369 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:16:24.505861 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd705892-0eeb-4ec5-b253-441a7b36158d]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:24.506077 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:16:24.506454 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:16:24.507561 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:24.515952 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:24.516105 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5f362-6f24-40ef-a765-3cd9dff50d00]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:24.516927 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:24.526920 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:24.527036 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb19005d-27ef-461d-8892-66536cd9967f]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:24.527859 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53f5d67-8df6-4259-9519-91a0b26a9bf4]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:24.528163 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:24.538624 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:24.538870 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:16:24.540518 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:16:24.541466 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::b80e:94ff:fee9:21dc'] Jan 22 10:16:24.541628 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:16:24.541850 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:16:24.542665 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::b80e:94ff:fee9:21dc']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:28.550798 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:16:28.551461 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'target_lun': 0, 'volume_id': '2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'auth_method': 'CHAP', 'auth_username': 'PHvEDyDv2pk6ywS3ST2p', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:28.551609 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:28.551970 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:28.552102 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'target_lun': 0, 'volume_id': '2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'auth_method': 'CHAP', 'auth_username': 'PHvEDyDv2pk6ywS3ST2p', 'auth_password': 'WERkdUZ4YD8zps2V', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:16:28.552817 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:28.557708 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ecc3e166-2d80-4530-8b55-fa8a750cf50f]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:28.560952 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:28.561322 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc3e166-2d80-4530-8b55-fa8a750cf50f]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:28.562405 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:28.563198 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:28.563939 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:28.565190 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:28.576678 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260" returned: 21 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:28.578130 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514b5fa-4340-4543-8f94-4b9e32cff6dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:28.578841 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:16:28.578841 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:28.580145 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:28.595876 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:28.596129 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fa99cd-f2e1-45d9-89a6-59cf81e22f89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:28.596839 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2] added Jan 22 10:16:28.596839 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:16:28.596839 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:28.596839 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:28.596839 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:28.597117 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:16:28.597807 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:16:28.598137 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:16:29.599635 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:29.601374 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.615154 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.615573 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c760a-e230-4edd-8e2c-131e2fd817d7]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:16:29.616321 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.620063 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.624715 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.624855 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb156719-00ee-4141-b2a4-28d572afd497]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.625145 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.626067 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.634521 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.635415 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2082f7c-c0dd-469d-9207-f7b1b994a3f1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.635691 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.637680 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v PHvEDyDv2pk6ywS3ST2p {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.643598 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v PHvEDyDv2pk6ywS3ST2p" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.643858 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f0484c-ae55-471d-bab8-1acf035d9c50]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.644619 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHvEDyDv2pk6ywS3ST2p'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.646155 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.657252 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.657416 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc071bea-a988-4987-8a55-ae33c9bda2d1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.657879 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.658765 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.669185 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.669607 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb809a-66bb-4ec9-8102-15c98a0d3c5f]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.669885 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:29.669885 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:29.670049 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:29.670049 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:29.672194 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.687618 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --login" returned: 0 in 0.017s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.688082 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c9ce57-42b2-4f2f-9633-f40bd7695d45]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.688384 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260] successful. Jan 22 10:16:29.688384 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.689272 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.703152 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.013s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.703435 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d927bac-69af-4c3b-b134-301825e9a83a]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.703725 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:29.705702 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.712558 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.712667 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d710bec-0e1f-4f9a-a6e6-3aa39660fc04]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.713056 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:29.713056 np0005592324.novalocal cinder-backup[182863]: tcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash) Jan 22 10:16:29.713056 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:29.713248 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:29.713248 np0005592324.novalocal cinder-backup[182863]: tcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash) Jan 22 10:16:29.713248 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:29.716267 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:29.716267 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:16:29.716267 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] HCTL ('3', '-', '-', 0) found on session 17 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:16:29.716267 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:16:29.716267 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:29.746347 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.029s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:29.746518 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec213dbf-c14f-4a42-a3d6-8e7c5f08b723]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:29.747140 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 17 and hctl ['3', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:30.749163 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 17 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:30.749708 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'target_lun': 0, 'volume_id': '2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'auth_method': 'CHAP', 'auth_username': 'PHvEDyDv2pk6ywS3ST2p', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:16:30.750298 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.198s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:30.750539 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2198ms) {'type': 'block', 'scsi_wwn': '36001405dc2c0815f0c548cdba0302136', 'path': '/dev/sdb'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:30.750969 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:30.779469 np0005592324.novalocal sudo[212589]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 22 10:16:30.881224 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:16:30.881393 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:16:31.121747 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.371s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:31.131236 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:16:31.136451 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1567908794, sha256 filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_sha256file. {{(pid=182863) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:336}} Jan 22 10:16:31.173614 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _read_sha256file finished. {{(pid=182863) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:343}} Jan 22 10:16:31.180079 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _create_container started, container: volumebackups,backup: b04181a5-7827-484f-b8e1-e66f0185b4f1. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:16:31.243428 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] generate_object_name_prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1 {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:16:31.248840 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] starting backup of volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0, volume size: 1073741824, object names prefix volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:16:35.297870 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:16:35.306088 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:16:35.306448 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:16:35.311278 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:16:35.311564 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:16:35.315782 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:16:35.316219 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:16:35.437521 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:16:35.438365 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: volumebackups, metadata filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:16:35.470417 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "b04181a5-7827-484f-b8e1-e66f0185b4f1",\n "backup_name": null,\n "created_at": "2026-01-22 15:16:23+00:00",\n "objects": [],\n "parent_id": "29467ca2-7202-4806-ba56-4fcd07b80a13",\n "version": "1.0.0",\n "volume_id": "650b26c3-82c3-4591-8e3b-0cdf389cd2c0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"650b26c3-82c3-4591-8e3b-0cdf389cd2c0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:15:07.000000\\", \\"launched_at\\": \\"2026-01-22T15:15:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1220743166\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 0\\", \\"provider_auth\\": \\"CHAP MbTqP7Rn67MxU59SR5C6 Uxd2UDMa6952GPyJ\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:15:07.000000\\", \\"updated_at\\": \\"2026-01-22T15:16:23.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:16:35.476996 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] backup b04181a5-7827-484f-b8e1-e66f0185b4f1 finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:16:35.564360 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.590336 np0005592324.novalocal sudo[212671]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 22 10:16:35.909193 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.345s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:35.910685 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'target_lun': 0, 'volume_id': '2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 'auth_method': 'CHAP', 'auth_username': 'PHvEDyDv2pk6ywS3ST2p', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405dc2c0815f0c548cdba0302136', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:35.910685 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:35.910685 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:35.911848 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.920584 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:35.920744 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86dab99-50c9-41d3-8698-a1122b892c78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:35.921069 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:35.921408 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:16:35.921408 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:16:35.921408 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:16:35.921408 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:16:35.923980 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.929809 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:35.930261 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189e44a-d13d-4881-be8b-5c6ea678f34d]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:35.930903 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.938759 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:35.938887 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f6e69-cfa8-4a9e-99d6-f43f549bf6fd]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: tcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash) Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: tcp: [17] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 (non-flash) Jan 22 10:16:35.939363 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:35.940295 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f3004540180>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2'): ({'sdb'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:16:35.940295 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdb {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:16:35.943123 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.951195 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[e6aff28d-3ad3-4d0d-a9be-7004950c05c5]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:35.951345 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:35.953153 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aff28d-3ad3-4d0d-a9be-7004950c05c5]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:35.953153 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdb {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:16:35.955725 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:35.959918 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:35.960040 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f6252-4d90-40e8-bb80-5d6a18da1700]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:35.960573 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:16:35.960945 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:36.003823 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:36.005579 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b23a1-8e3d-4dc2-80b8-d6167303938c]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:36.005874 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:16:36.005959 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:16:36.006240 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:16:36.008789 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:36.017056 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:36.017398 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8ad9a-e8b3-456e-8fe1-fe70751576b4]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:36.017587 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:36.018128 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:36.046523 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --logout" returned: 0 in 0.028s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:36.046801 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b256e9-a173-450b-b861-e229d8e589b5]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:36.047859 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260] Jan 22 10:16:36.047859 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2, portal: 38.102.83.245,3260] successful. Jan 22 10:16:36.047859 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:36.049763 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:36.055042 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-2adecc46-54e6-4ea6-b182-3d3c706ae4c2 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:36.055042 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e1d14-49b3-489a-90ab-3b87c04260c1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:36.055042 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:36.055042 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.144s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:36.055301 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (145ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:39.602636 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-b47c6ba7-6c5c-4415-94fb-4d43991ada4d tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: b04181a5-7827-484f-b8e1-e66f0185b4f1. Jan 22 10:16:40.765534 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: b04181a5-7827-484f-b8e1-e66f0185b4f1. Jan 22 10:16:40.766379 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:16:40.766505 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:16:40.766669 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] delete started, backup: b04181a5-7827-484f-b8e1-e66f0185b4f1, container: volumebackups, prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:16:40.841910 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_metadata', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:16:40.874897 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_metadata in container: volumebackups. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:16:40.909247 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151631/az_nova_backup_b04181a5-7827-484f-b8e1-e66f0185b4f1_sha256file in container: volumebackups. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:16:40.909540 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] delete b04181a5-7827-484f-b8e1-e66f0185b4f1 finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:16:40.916597 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:16:40.990723 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] Created reservations ['d5f5709a-88b8-4abe-bc6d-b56d52ba620a', '8ee2039f-c70e-43f8-92be-c7225b7d7891'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:16:41.016624 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-bbc12d7a-efad-4278-be22-a21ed2080aff tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup b04181a5-7827-484f-b8e1-e66f0185b4f1 deleted. Jan 22 10:16:41.999060 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Create backup started, backup: e513330b-790d-44fc-8c8f-8795ed1996ac volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0. Jan 22 10:16:42.003447 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-904786921',created_at=2026-01-22T15:16:41Z,data_timestamp=2026-01-22T15:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1443971199',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=e513330b-790d-44fc-8c8f-8795ed1996ac,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(29467ca2-7202-4806-ba56-4fcd07b80a13),parent_id='29467ca2-7202-4806-ba56-4fcd07b80a13',project_id='1178790fcc384abba0a95686179e62ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c031881c9045429093b7671291d76472',volume_id=650b26c3-82c3-4591-8e3b-0cdf389cd2c0) Jan 22 10:16:43.363982 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:16:43.364406 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:16:43.364406 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:43.365339 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:43.373984 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:43.374137 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[be39cf17-56b7-4883-8023-cea3b88987f7]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f3844371-2c32-46cb-96b5-be9d4dd4a577]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:43.376128 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:16:43.376474 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3844371-2c32-46cb-96b5-be9d4dd4a577]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:43.376930 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:16:43.377292 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:16:43.379682 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:43.387181 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:43.387346 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7656c85-8956-4ef8-8711-3fa978c8486a]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:43.387982 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:43.395608 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:43.397135 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c4053-9dd8-4ebf-bc5f-766367c4cebe]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:43.398076 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c13f72a-8f18-4803-be51-b8c2b521b6fb]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:43.398537 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:43.409444 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:43.409657 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:16:43.410586 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:16:43.411313 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::b80e:94ff:fee9:21dc'] Jan 22 10:16:43.411555 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:16:43.411705 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:16:43.412038 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] <== get_connector_properties: return (47ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fee9:b451', 'fe80::4c4b:afff:fe41:8656', 'fe80::fc16:3eff:fe0b:aff6', 'fe80::b80e:94ff:fee9:21dc']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:46.924977 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:16:46.928285 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'target_lun': 0, 'volume_id': '0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'auth_method': 'CHAP', 'auth_username': 'q2d74Be5sPkzNrufdSgP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:46.928714 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:46.931144 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:46.931454 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'target_lun': 0, 'volume_id': '0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'auth_method': 'CHAP', 'auth_username': 'q2d74Be5sPkzNrufdSgP', 'auth_password': 'nFJFskQ7TKUjBsVa', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:16:46.935290 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[22eae567-9ad9-49fc-8dcd-a2d4c58f4e53]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:46.939034 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:46.941309 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eae567-9ad9-49fc-8dcd-a2d4c58f4e53]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:46.942297 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:46.943043 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:46.944539 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:46.945661 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:46.956691 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260" returned: 21 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:46.956845 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5956402-de58-46a6-814f-e82c5512c9b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:46.957213 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:16:46.957213 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:46.959793 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:46.969733 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:46.969931 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[544118a8-212e-411a-8682-3581fb91b6cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:46.970444 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd] added Jan 22 10:16:46.970444 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:16:46.970444 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:46.970444 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:16:46.970444 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:46.970707 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:16:46.971312 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:16:46.971598 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:16:47.972892 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:16:47.977232 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:47.985968 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:47.988247 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7553d7a5-f66e-4812-b61f-b54b356c5d2e]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:16:47.988396 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:47.990196 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.002076 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.002076 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eefa35-60cf-443f-9c69-71ba02293188]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.002076 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.002821 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.015001 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.015734 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[06335dc5-427d-4af4-ad4c-2e1531d83b10]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.015734 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.016373 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.username -v q2d74Be5sPkzNrufdSgP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.027265 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.username -v q2d74Be5sPkzNrufdSgP" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.028137 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dcfaa8-47f1-4c40-928b-8aa20a993db2]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.028500 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'q2d74Be5sPkzNrufdSgP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.030679 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.042113 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.042113 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f507c5-caf9-4fae-8ead-c59027177d83]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.042113 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.043716 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.053156 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.056024 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4068ccfe-5043-4602-ae5d-f6090c7915c3]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.056024 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:48.056024 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:48.056024 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:48.056024 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:48.057136 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.085588 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --login" returned: 0 in 0.027s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.085588 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2fad2e-6f28-4346-8f20-cdaefc54ff1e]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.085588 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260] successful. Jan 22 10:16:48.085588 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.087227 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.101877 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.101877 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aaf18d-9237-4e6f-85e6-02f62bb9fe84]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.101877 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:48.102410 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.113373 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.113748 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[857a12a0-bb6d-4adf-bfe4-0c233e8f2942]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.114463 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:48.114463 np0005592324.novalocal cinder-backup[182863]: tcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash) Jan 22 10:16:48.114463 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:48.114819 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:48.114819 np0005592324.novalocal cinder-backup[182863]: tcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash) Jan 22 10:16:48.114819 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:48.115358 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:48.115636 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:16:48.116287 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] HCTL ('3', '-', '-', 0) found on session 18 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:16:48.116532 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Scanning host 3 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:16:48.117650 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host3/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:48.156778 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host3/scan" returned: 0 in 0.039s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:48.157083 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[386216b0-0667-454c-b11c-1bdfedce2fe1]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:48.157615 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 18 and hctl ['3', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:49.159489 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Searching for a device in session 18 and hctl ['3', '*', '*', 0] yield: sdb {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:16:49.160370 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Connected to sdb using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'target_lun': 0, 'volume_id': '0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'auth_method': 'CHAP', 'auth_username': 'q2d74Be5sPkzNrufdSgP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:16:49.161223 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.232s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:49.161611 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] <== connect_volume: return (2232ms) {'type': 'block', 'scsi_wwn': '360014054c2fdeaa412f4b95ac645e5c1', 'path': '/dev/sdb'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:49.163874 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:49.198845 np0005592324.novalocal sudo[213106]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb Jan 22 10:16:49.544348 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sdb" returned: 0 in 0.378s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:49.546617 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:16:49.554508 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1567908794, sha256 filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_sha256file. {{(pid=182863) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:336}} Jan 22 10:16:49.610918 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _read_sha256file finished. {{(pid=182863) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:343}} Jan 22 10:16:49.620509 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _create_container started, container: tempest-volumesbackupstest-backup-container-904786921,backup: e513330b-790d-44fc-8c8f-8795ed1996ac. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:16:49.676598 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] generate_object_name_prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:16:49.684423 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] starting backup of volume: 650b26c3-82c3-4591-8e3b-0cdf389cd2c0, volume size: 1073741824, object names prefix volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:16:54.536195 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:16:54.545692 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:16:54.545837 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:16:54.552005 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:16:54.552005 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:16:54.553354 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:16:54.553600 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-904786921, sha256file filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:16:54.638746 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:16:54.638746 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-904786921, metadata filename: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:16:54.664791 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "e513330b-790d-44fc-8c8f-8795ed1996ac",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1443971199",\n "created_at": "2026-01-22 15:16:41+00:00",\n "objects": [],\n "parent_id": "29467ca2-7202-4806-ba56-4fcd07b80a13",\n "version": "1.0.0",\n "volume_id": "650b26c3-82c3-4591-8e3b-0cdf389cd2c0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"650b26c3-82c3-4591-8e3b-0cdf389cd2c0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c031881c9045429093b7671291d76472\\", \\"project_id\\": \\"1178790fcc384abba0a95686179e62ac\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:15:07.000000\\", \\"launched_at\\": \\"2026-01-22T15:15:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1220743166\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 0\\", \\"provider_auth\\": \\"CHAP MbTqP7Rn67MxU59SR5C6 Uxd2UDMa6952GPyJ\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:15:07.000000\\", \\"updated_at\\": \\"2026-01-22T15:16:41.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:16:54.668382 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=112,cinder:UPDATE=25,cinder:INSERT=2 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:16:54.671521 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] backup e513330b-790d-44fc-8c8f-8795ed1996ac finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:16:54.760982 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:54.782467 np0005592324.novalocal sudo[213326]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jan 22 10:16:55.090792 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.328s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.091557 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'target_lun': 0, 'volume_id': '0ba474da-c5dd-48cb-bea4-de99581d1dfd', 'auth_method': 'CHAP', 'auth_username': 'q2d74Be5sPkzNrufdSgP', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '360014054c2fdeaa412f4b95ac645e5c1', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:16:55.092583 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:16:55.093339 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:16:55.095347 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.104533 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.104884 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1592e7-16a7-428b-95a9-40777d398604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:16:55.105626 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:55.105986 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:16:55.105986 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:16:55.105986 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:16:55.106535 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:16:55.110219 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.130012 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.131189 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27a179-c490-426f-8b6c-613f1fa7aa03]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd\n38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.132971 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.148389 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.151775 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d6887f-cbbe-40da-90ea-553c101c21ac]: (4, ('tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash)\ntcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.152309 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('-m', 'session'): stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:55.152309 np0005592324.novalocal cinder-backup[182863]: tcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash) Jan 22 10:16:55.152309 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:16:55.152628 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsi session list stdout=tcp: [15] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-650b26c3-82c3-4591-8e3b-0cdf389cd2c0 (non-flash) Jan 22 10:16:55.152628 np0005592324.novalocal cinder-backup[182863]: tcp: [18] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd (non-flash) Jan 22 10:16:55.152628 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:16:55.153785 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Resulting device map defaultdict(. at 0x7f30044ad620>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd'): ({'sdb'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:16:55.154094 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Removing single pathed devices sdb {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:16:55.156919 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.162785 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a7138dd1-0a66-4228-a9fb-6505e0ed980c]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:16:55.163677 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:16:55.164492 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7138dd1-0a66-4228-a9fb-6505e0ed980c]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.165190 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Flushing IO for device /dev/sdb {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:16:55.168679 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.185908 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.185908 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1248609-9175-45e6-9176-e3a535e88aa5]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.188645 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:16:55.189870 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.220889 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.221129 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0375439f-653f-4850-ac14-53e977e239b1]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.221683 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:16:55.221944 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] SCSI volumes sdb have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:16:55.222615 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:16:55.225540 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.230490 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.230583 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a402f30f-9f9f-49b0-a3f0-3de4304a50ff]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.230918 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:55.232504 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.256800 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --logout" returned: 0 in 0.025s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.256978 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21823161-0176-45fb-bc88-32727a18a78c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.259528 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260] Jan 22 10:16:55.259528 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd, portal: 38.102.83.245,3260] successful. Jan 22 10:16:55.259528 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:55.262170 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:16:55.269393 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-0ba474da-c5dd-48cb-bea4-de99581d1dfd -p 38.102.83.245:3260 --op delete" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:16:55.269670 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115b83a-31e7-46db-8997-9141b353686d]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:16:55.269879 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:16:55.270089 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.177s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:16:55.270234 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] <== disconnect_volume: return (178ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:16:58.843065 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-f602a6a6-019a-4fbf-892d-42f3884b32d6 tempest-VolumesBackupsTest-1493266278 None] Create backup finished. backup: e513330b-790d-44fc-8c8f-8795ed1996ac. Jan 22 10:16:59.585602 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: e513330b-790d-44fc-8c8f-8795ed1996ac. Jan 22 10:16:59.587579 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:16:59.587708 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:16:59.588399 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] delete started, backup: e513330b-790d-44fc-8c8f-8795ed1996ac, container: tempest-volumesbackupstest-backup-container-904786921, prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:16:59.658970 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_metadata', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:16:59.681194 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_metadata in container: tempest-volumesbackupstest-backup-container-904786921. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:16:59.703788 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151649/az_nova_backup_e513330b-790d-44fc-8c8f-8795ed1996ac_sha256file in container: tempest-volumesbackupstest-backup-container-904786921. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:16:59.704093 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] delete e513330b-790d-44fc-8c8f-8795ed1996ac finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:16:59.706509 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:16:59.720129 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] Created reservations ['9ba53889-cfd5-4154-bc4e-12c444a6821e', '878f1629-3716-45b8-8ad2-1011c16298c4'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:16:59.739418 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-1bc1cb8f-6e71-436b-9233-e25dc2889562 tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup e513330b-790d-44fc-8c8f-8795ed1996ac deleted. Jan 22 10:17:00.762384 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] Delete backup started, backup: 29467ca2-7202-4806-ba56-4fcd07b80a13. Jan 22 10:17:00.763307 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_1178790fcc384abba0a95686179e62ac {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:17:00.763446 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:17:00.763574 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] delete started, backup: 29467ca2-7202-4806-ba56-4fcd07b80a13, container: tempest-volumesbackupstest-backup-container-1567908794, prefix: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:17:00.857662 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] generated object list: ['volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00001', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00002', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00003', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00004', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00005', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00006', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00007', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00008', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00009', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00010', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00011', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00012', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00013', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00014', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00015', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00016', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00017', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00018', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00019', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00020', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00021', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_metadata', 'volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:17:00.881994 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00001 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:00.905972 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00002 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:00.933041 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00003 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:00.951129 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00004 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:00.969326 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00005 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:00.995008 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00006 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.016978 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00007 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.041947 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00008 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.065070 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00009 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.097423 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00010 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.129835 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00011 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.163711 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00012 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.204414 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00013 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.231408 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00014 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.270804 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00015 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.318709 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00016 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.353938 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00017 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.389809 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00018 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.419165 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00019 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.443394 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00020 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.472954 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13-00021 in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.502654 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_metadata in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.533263 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] deleted object: volume_650b26c3-82c3-4591-8e3b-0cdf389cd2c0/20260122151607/az_nova_backup_29467ca2-7202-4806-ba56-4fcd07b80a13_sha256file in container: tempest-volumesbackupstest-backup-container-1567908794. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:17:01.533525 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] delete 29467ca2-7202-4806-ba56-4fcd07b80a13 finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:17:01.537799 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:17:01.552192 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] Created reservations ['4ab904b3-1304-4df2-a403-f2932a23f2df', 'fdbf670c-40b6-4d7c-a99e-f4e7795a7bb5'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:17:01.566640 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-8d323989-84fb-4d5e-b2a3-72768a07fa1b tempest-VolumesBackupsTest-1493266278 None] Delete backup finished, backup 29467ca2-7202-4806-ba56-4fcd07b80a13 deleted. Jan 22 10:17:11.565582 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:17:30.878154 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:17:30.878154 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:18:19.880841 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:18:30.884625 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:18:30.884625 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:19:30.880066 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:19:30.880707 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:20:19.879000 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:20:30.885569 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:20:30.885993 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:21:30.889710 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:21:30.890128 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:21:43.827280 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Create backup started, backup: 1bc4fde7-4322-467d-90f2-3d21eff12cf7 volume: 582803e4-1c9c-4065-9cc1-36d1ecbedb16 snapshot: 76236558-e6f4-4eac-b527-dc98912665a0. Jan 22 10:21:43.832367 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-1716147395',created_at=2026-01-22T15:21:43Z,data_timestamp=2026-01-22T15:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-2000350718',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=1bc4fde7-4322-467d-90f2-3d21eff12cf7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e619e0e2540e4ee186ddfc298b429d46',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='76236558-e6f4-4eac-b527-dc98912665a0',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e5be6eb9c98f44a8a18007a3e37dd7e2',volume_id=582803e4-1c9c-4065-9cc1-36d1ecbedb16) Jan 22 10:21:45.569632 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_e619e0e2540e4ee186ddfc298b429d46 {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:21:45.570444 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:21:45.570747 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:21:45.572336 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:45.577273 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.005s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:45.577598 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc545a-a834-4a07-8429-81411b167ce3]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4fd3c0a4-4ae4-40bd-babc-a5fd688b0662]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:45.579532 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:21:45.580312 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3c0a4-4ae4-40bd-babc-a5fd688b0662]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:45.580808 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:21:45.581390 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:21:45.582268 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:45.589888 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:45.590200 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e83d368-61cf-4187-b76f-b4084cba00a5]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:45.591280 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:45.599090 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:45.599485 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881f217-6882-451a-b159-ff9acdb0e4d6]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:45.600547 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd9d32f-19d5-4d43-bf5c-f111ddf24688]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:45.601103 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:45.612626 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:21:45.612820 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:21:45.613966 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:21:45.614707 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fec3:85e7', 'fe80::68e6:cff:fec2:5f29'] Jan 22 10:21:45.614837 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:21:45.614952 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:21:45.615193 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] <== get_connector_properties: return (44ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945', 'fe80::fc16:3eff:fec3:85e7', 'fe80::68e6:cff:fec2:5f29']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:21:49.122317 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:21:49.123126 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1', 'target_lun': 0, 'volume_id': 'dc77d1ba-f18d-40d4-936a-557e857f51a1', 'auth_method': 'CHAP', 'auth_username': 'MktaZUCHMCFukmb63kG8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:21:49.123379 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:21:49.123883 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:21:49.124100 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1', 'target_lun': 0, 'volume_id': 'dc77d1ba-f18d-40d4-936a-557e857f51a1', 'auth_method': 'CHAP', 'auth_username': 'MktaZUCHMCFukmb63kG8', 'auth_password': 'jcdY7NJbGprwVgF2', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:21:49.125060 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:49.130244 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d2396ab5-25db-410b-8d8d-28e66d93f73e]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:21:49.131350 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:21:49.132247 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2396ab5-25db-410b-8d8d-28e66d93f73e]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:49.132904 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:21:49.133434 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:21:49.133737 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:21:49.135081 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:49.145385 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260" returned: 21 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:49.145718 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7cef39-5f77-4bfd-b0d3-0cb297a0532a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:49.145927 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:21:49.145927 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:49.146671 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:49.154842 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:49.155020 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[333bbef8-0003-49b2-9bf4-f81845d9f18f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:49.155392 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1] added Jan 22 10:21:49.155392 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:21:49.155392 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:21:49.155392 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:21:49.155392 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:49.155571 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:21:49.156022 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:21:49.156271 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:21:50.157795 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:21:50.158974 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.165393 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.165545 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce7368-aea9-4784-8b74-4e4b98114225]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:21:50.166394 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.167636 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.174778 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.174895 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ce9a5-a66b-4957-ab70-4e9b07c4ed21]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.175124 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.175648 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.182658 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.183331 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[296fe253-a723-450c-a656-9c822497cda4]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.183850 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.184890 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v MktaZUCHMCFukmb63kG8 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.193556 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.username -v MktaZUCHMCFukmb63kG8" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.193905 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ce43a4-9b9b-47b4-8b79-50ff8bfe9300]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.194667 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MktaZUCHMCFukmb63kG8'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.196181 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.205163 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.205524 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85709710-33db-4553-b498-701c39c82a1f]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.206355 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.207428 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.215937 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.216359 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bfb8e5-4364-4566-b98a-d7a734a3c219]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.217141 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 22 10:21:50.217141 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:21:50.217672 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 22 10:21:50.217672 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:21:50.218046 np0005592324.novalocal cinder-backup[182863]: WARNING os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 22 10:21:50.218046 np0005592324.novalocal cinder-backup[182863]: Jan 22 10:21:50.219387 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.232248 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --login" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.232248 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b092eb-795e-427f-b5b8-97d6452829d1]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.232641 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260] successful. Jan 22 10:21:50.232641 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.233555 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.240966 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.241140 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d6bb9-a2be-45a2-bb77-48defdc9b32d]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.241533 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:21:50.242257 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.249737 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.249985 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521157e-7793-4605-a41e-8e285408c7a6]: (4, ('tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.250488 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('-m', 'session'): stdout=tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash) Jan 22 10:21:50.250488 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:21:50.250743 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsi session list stdout=tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash) Jan 22 10:21:50.250743 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:21:50.251303 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:21:50.251591 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:21:50.252583 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] HCTL ('2', '-', '-', 0) found on session 20 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:21:50.252871 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:21:50.253673 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:50.275640 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.022s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:50.275824 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7973a4-c0fe-4470-9c61-e972c808aec7]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:21:50.276440 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Searching for a device in session 20 and hctl ['2', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:21:51.278090 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Searching for a device in session 20 and hctl ['2', '*', '*', 0] yield: sda {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:21:51.278940 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1', 'target_lun': 0, 'volume_id': 'dc77d1ba-f18d-40d4-936a-557e857f51a1', 'auth_method': 'CHAP', 'auth_username': 'MktaZUCHMCFukmb63kG8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:21:51.279957 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.156s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:21:51.280461 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] <== connect_volume: return (2156ms) {'type': 'block', 'scsi_wwn': '36001405630f94c88fca426c92eec76ac', 'path': '/dev/sda'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:21:51.281165 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:21:51.307541 np0005592324.novalocal sudo[218967]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 22 10:21:51.670436 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.389s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:21:51.676473 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:21:51.682430 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-1716147395,backup: 1bc4fde7-4322-467d-90f2-3d21eff12cf7. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:21:51.885057 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] generate_object_name_prefix: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7 {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:21:51.889722 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] starting backup of volume: 582803e4-1c9c-4065-9cc1-36d1ecbedb16, volume size: 1073741824, object names prefix volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:21:52.299975 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:52.424814 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:52.424967 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:52.583719 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:52.583932 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:52.712783 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:52.908262 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:52.908404 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:53.022641 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:53.022749 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:53.577281 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:53.688499 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:53.688611 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:53.794119 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:53.794284 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:53.939646 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:54.059479 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:54.059763 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:54.187555 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:54.188791 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:54.601757 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:54.709905 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:54.710126 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:54.827647 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:54.830217 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:55.251656 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:55.357713 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:55.357835 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:55.470194 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:55.470309 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:55.704922 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:55.830819 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:55.831013 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:55.941029 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:55.941151 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:56.108580 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:56.223861 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:56.224051 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:56.337919 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:56.338172 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:56.444660 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:56.545306 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:56.545491 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:56.709623 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:56.709892 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:56.884059 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:57.015376 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:57.015490 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:57.126472 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:57.126636 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:57.311935 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:57.459628 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:57.459880 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:57.571450 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:57.571592 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:57.751120 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:57.852637 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:57.852637 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:57.977557 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:57.977713 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:58.344232 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:58.456864 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:58.456963 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:58.582576 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:58.582946 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:58.742912 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:58.843787 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:58.844114 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:58.983873 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:58.984131 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:59.165511 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:59.292794 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:59.293081 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:21:59.408071 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:21:59.408354 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:21:59.798109 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:21:59.944168 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:21:59.944579 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:00.100919 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:00.100919 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:00.243737 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:22:00.384784 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:22:00.384936 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:00.505292 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:00.505584 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:00.925361 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:22:01.062793 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:22:01.063317 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:01.171722 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:01.171850 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:01.324893 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:22:01.380674 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:22:01.380808 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:01.523673 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:01.523800 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:01.624677 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:22:01.720727 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:22:01.720881 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:01.831005 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:01.831148 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:01.898390 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:22:01.966510 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:22:01.966813 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:22:02.075245 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup MD5 for volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:22:02.075778 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:22:02.082279 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:22:02.096118 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:22:02.096462 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:22:02.102234 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:22:02.102530 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:22:02.107741 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:22:02.107974 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-1716147395, sha256file filename: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:22:02.194077 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:22:02.194952 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-1716147395, metadata filename: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:22:02.227397 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1bc4fde7-4322-467d-90f2-3d21eff12cf7",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-2000350718",\n "created_at": "2026-01-22 15:21:43+00:00",\n "objects": [\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "582803e4-1c9c-4065-9cc1-36d1ecbedb16",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"582803e4-1c9c-4065-9cc1-36d1ecbedb16\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"e5be6eb9c98f44a8a18007a3e37dd7e2\\", \\"project_id\\": \\"e619e0e2540e4ee186ddfc298b429d46\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:21:41.000000\\", \\"launched_at\\": \\"2026-01-22T15:21:42.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-483850559\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:21:41.000000\\", \\"updated_at\\": \\"2026-01-22T15:21:42.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:22:02.230783 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] backup 1bc4fde7-4322-467d-90f2-3d21eff12cf7 finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:22:02.314966 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.331503 np0005592324.novalocal sudo[219061]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 22 10:22:02.644749 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.330s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.645559 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1', 'target_lun': 0, 'volume_id': 'dc77d1ba-f18d-40d4-936a-557e857f51a1', 'auth_method': 'CHAP', 'auth_username': 'MktaZUCHMCFukmb63kG8', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405630f94c88fca426c92eec76ac', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:22:02.645726 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:22:02.646107 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:22:02.649141 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.657256 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.657585 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1211e7c5-f224-4f79-83c8-81dc7e7ec08d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:22:02.658033 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:22:02.658179 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:22:02.658179 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:22:02.658179 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:22:02.658539 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:22:02.659293 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.668132 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.668338 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccba1f9a-2c2f-4f22-bfbf-09ea7f753648]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.669165 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.683928 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.684102 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17328d9e-7766-4a89-8083-2e6f428bd9e0]: (4, ('tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.684470 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('-m', 'session'): stdout=tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash) Jan 22 10:22:02.684470 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:22:02.684608 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsi session list stdout=tcp: [20] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 (non-flash) Jan 22 10:22:02.684608 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:22:02.685100 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Resulting device map defaultdict(. at 0x7f300455b740>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1'): ({'sda'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:22:02.685326 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Removing single pathed devices sda {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:22:02.686573 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.693083 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[16e0afd2-28be-48d9-85ae-bf84105c5109]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:22:02.695222 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:22:02.696989 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e0afd2-28be-48d9-85ae-bf84105c5109]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.697502 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Flushing IO for device /dev/sda {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:22:02.698259 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.704782 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.006s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.705115 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[225fa814-c0b3-44d3-81f8-e4f60929dae9]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.705422 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:22:02.706159 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.754635 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.048s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.754798 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d90ceea-41ff-4869-9283-e2ca45aed237]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.755180 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Checking to see if SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:22:02.755511 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:22:02.755845 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:22:02.756873 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.764235 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.764532 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd86a4-b07c-48ed-b48b-5a84aace8700]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.764784 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:22:02.765762 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.793984 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --logout" returned: 0 in 0.028s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.794533 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada53720-d3e6-4988-a537-fd6a40bb3fc8]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.794883 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260] Jan 22 10:22:02.794883 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1, portal: 38.102.83.245,3260] successful. Jan 22 10:22:02.794883 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:22:02.795828 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:22:02.802640 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-dc77d1ba-f18d-40d4-936a-557e857f51a1 -p 38.102.83.245:3260 --op delete" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:22:02.802747 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b020d-9006-4830-b722-407cf5013973]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:22:02.803027 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:22:02.803280 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.157s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:22:02.803420 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] <== disconnect_volume: return (157ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:22:06.358112 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-5b4b087e-5eca-474e-88c9-64fef761bcc6 tempest-VolumesSnapshotTestJSON-841832484 None] Create backup finished. backup: 1bc4fde7-4322-467d-90f2-3d21eff12cf7. Jan 22 10:22:06.443959 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] Delete backup started, backup: 1bc4fde7-4322-467d-90f2-3d21eff12cf7. Jan 22 10:22:06.444910 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_e619e0e2540e4ee186ddfc298b429d46 {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:22:06.445084 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:22:06.446365 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] delete started, backup: 1bc4fde7-4322-467d-90f2-3d21eff12cf7, container: tempest-volumessnapshottestjson-backup-container-1716147395, prefix: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:22:06.515644 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] generated object list: ['volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00001', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00002', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00003', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00004', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00005', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00006', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00007', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00008', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00009', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00010', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00011', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00012', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00013', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00014', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00015', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00016', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00017', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00018', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00019', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00020', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00021', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_metadata', 'volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:22:06.539688 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00001 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.575250 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00002 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.610328 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00003 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.640264 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00004 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.662774 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00005 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.691232 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00006 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.718159 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00007 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.751830 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00008 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.777012 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00009 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.803244 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00010 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.824855 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00011 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.848875 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00012 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.869625 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00013 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.891511 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00014 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.921053 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00015 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.953851 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00016 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:06.978232 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00017 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.003361 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00018 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.025707 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00019 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.043420 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00020 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.065833 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7-00021 in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.090064 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_metadata in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.112589 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] deleted object: volume_582803e4-1c9c-4065-9cc1-36d1ecbedb16/20260122152151/az_nova_backup_1bc4fde7-4322-467d-90f2-3d21eff12cf7_sha256file in container: tempest-volumessnapshottestjson-backup-container-1716147395. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:22:07.112972 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] delete 1bc4fde7-4322-467d-90f2-3d21eff12cf7 finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:22:07.115786 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:22:07.131345 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] Created reservations ['6857bef0-edf0-4a3b-951c-e3e85a6f3535', '9356e023-e8ba-419a-af1a-3047c22c4e03'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:22:07.148223 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-ad191e96-e19d-40e5-b54a-c23cd8e6d814 tempest-VolumesSnapshotTestJSON-841832484 None] Delete backup finished, backup 1bc4fde7-4322-467d-90f2-3d21eff12cf7 deleted. Jan 22 10:22:19.878525 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=42,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:22:30.892847 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:22:30.893333 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:23:30.896064 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:23:30.896894 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:24:19.882687 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:24:30.899768 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:24:30.900502 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:25:30.902784 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:25:30.903499 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:26:19.884619 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:27:30.908959 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:27:30.909679 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:28:19.887925 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:28:30.909908 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:28:30.910435 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:29:30.915050 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:29:30.915539 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:30:19.889534 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:30:30.912230 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:30:30.912641 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:31:30.917651 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:31:30.918052 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:32:19.890133 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:32:30.922836 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:32:30.923240 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:32:40.498580 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Create backup started, backup: e92da556-5331-4f29-b060-5a3f0ad52431 volume: a7bf7eee-1316-4568-a60a-35e7db4a004b. Jan 22 10:32:40.502972 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-866992664',created_at=2026-01-22T15:32:40Z,data_timestamp=2026-01-22T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1729358917',encryption_key_id=None,fail_reason=None,host='np0005592324.novalocal',id=e92da556-5331-4f29-b060-5a3f0ad52431,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='844db69bbb744f37b147c986687d6963',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d7b8492286144293b2b4604f0e979d3c',volume_id=a7bf7eee-1316-4568-a60a-35e7db4a004b) Jan 22 10:32:40.547089 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_844db69bbb744f37b147c986687d6963 {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:32:40.547494 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:32:40.548105 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '38.102.83.245', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:32:40.549923 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:40.560614 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:40.560913 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[107599b9-1d97-41ed-9ed2-7d8218728d2a]: (4, ('InitiatorName=iqn.1994-05.com.redhat:c51830b0a1f2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7acceae6-b928-4eec-8f9b-ce953212a322]: [Errno 2] No such file or directory: '/dev/scini' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: with open_scini_device() as fd: Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: return next(self.gen) Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR) Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:40.563916 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: '/dev/scini' Jan 22 10:32:40.565194 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acceae6-b928-4eec-8f9b-ce953212a322]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 57, in get_guid\n with open_scini_device() as fd:\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/contextlib.py", line 137, in __enter__\n return next(self.gen)\n ^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/scaleio.py", line 40, in open_scini_device\n fd = os.open(SCINI_DEVICE_PATH, os.O_RDWR)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nFileNotFoundError: [Errno 2] No such file or directory: \'/dev/scini\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:40.566096 np0005592324.novalocal cinder-backup[182863]: ERROR os_brick.initiator.connectors.scaleio [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Error querying sdc guid: [Errno 2] No such file or directory: FileNotFoundError: [Errno 2] No such file or directory Jan 22 10:32:40.566670 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.scaleio [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Unable to find SDC guid: Error querying sdc guid: [Errno 2] No such file or directory Jan 22 10:32:40.567969 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:40.579845 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:40.580118 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e3045-dae2-4b74-8310-5042116f3cd5]: (4, ('/dev/vda2\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:40.582164 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/vda2 -s UUID -o value {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:40.594053 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/vda2 -s UUID -o value" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:40.594461 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6139f5a-d757-489f-a370-b87c3f959f28]: (4, ('161b08bb-a328-4446-bac6-6f93e53d93eb\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:40.596418 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[806fe05c-6349-4191-b339-f738aac821ef]: (4, '5447cd99-976a-4b0d-b896-ac0199f0bd49') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:40.597458 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Running cmd (subprocess): nvme version {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:40.616631 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] 'nvme version' failed. Not Retrying. {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:32:40.617095 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] nvme not present on system {{(pid=182863) nvme_present /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:784}} Jan 22 10:32:40.620134 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=182863) find_dsc /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:132}} Jan 22 10:32:40.621184 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.lightos [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Current host hostNQN nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 and IP(s) are ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945'] Jan 22 10:32:40.621518 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:109}} Jan 22 10:32:40.621785 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.lightos [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] LIGHTOS: finally hostnqn: nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13 dsc: {{(pid=182863) get_connector_properties /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:112}} Jan 22 10:32:40.622386 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '38.102.83.245', 'host': 'np0005592324.novalocal', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.1994-05.com.redhat:c51830b0a1f2', 'do_local_attach': False, 'uuid': '161b08bb-a328-4446-bac6-6f93e53d93eb', 'system uuid': '5447cd99-976a-4b0d-b896-ac0199f0bd49', 'nvme_native_multipath': False, 'nqn': 'nqn.2014-08.org.nvmexpress:uuid:bd9251c8-d775-4155-87be-221c52ebcd13', 'found_dsc': '', 'host_ips': ['38.102.83.245', 'fe80::f816:3eff:fe20:eb81', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::8449:a2ff:feee:1945']} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:32:44.633635 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connector [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Factory for iscsi on None {{(pid=182863) factory /usr/local/lib/python3.12/site-packages/os_brick/initiator/connector.py:281}} Jan 22 10:32:44.634907 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b', 'target_lun': 0, 'volume_id': 'a7bf7eee-1316-4568-a60a-35e7db4a004b', 'auth_method': 'CHAP', 'auth_username': 'Dhs3jG7VaMWAorhLm9Ko', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:32:44.635247 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:32:44.635955 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:32:44.636263 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Connection properties {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b', 'target_lun': 0, 'volume_id': 'a7bf7eee-1316-4568-a60a-35e7db4a004b', 'auth_method': 'CHAP', 'auth_username': 'Dhs3jG7VaMWAorhLm9Ko', 'auth_password': 'Aj5Foe7kvT572Yj2', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False} {{(pid=182863) check_multipath /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:133}} Jan 22 10:32:44.638656 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:44.644807 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ada5ebb0-6b5e-4387-9b20-1e2c18f6eae0]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:32:44.648651 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:32:44.650494 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada5ebb0-6b5e-4387-9b20-1e2c18f6eae0]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:44.651515 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Acquiring lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:32:44.652325 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:32:44.652792 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:32:44.654193 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:44.669510 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260" returned: 21 in 0.015s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:44.669870 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9ad6d-59e9-4fda-b643-e6bd54caffc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:44.670521 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jan 22 10:32:44.670521 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:44.671804 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --interface default --op new {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:44.687744 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:44.688698 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5affc5ca-60d9-4a88-9bd0-6af4b1ca1178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b] added\n', 'iscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\niscsiadm: Config file line 381 does not have value\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:44.689331 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 38.102.83.245,3260,-1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b] added Jan 22 10:32:44.689331 np0005592324.novalocal cinder-backup[182863]: stderr=iscsiadm: Config file line 381 does not have value Jan 22 10:32:44.689331 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:32:44.689331 np0005592324.novalocal cinder-backup[182863]: iscsiadm: Config file line 381 does not have value Jan 22 10:32:44.689331 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:44.689501 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Retrying to connect to iSCSI portal 38.102.83.245:3260 {{(pid=182863) _connect_to_iscsi_portal_unsafe /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1133}} Jan 22 10:32:44.690116 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/after.py:44}} Jan 22 10:32:44.690507 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.utils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1.0 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=182863) log_it /usr/local/lib/python3.12/site-packages/tenacity/before_sleep.py:65}} Jan 22 10:32:45.692541 np0005592324.novalocal cinder-backup[182863]: INFO os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Trying to connect to iSCSI portal 38.102.83.245:3260 Jan 22 10:32:45.693900 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.705190 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260" returned: 0 in 0.011s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.705640 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c15a2f-7745-405b-8331-fcd21371ca3e]: (4, ('# BEGIN RECORD 6.2.1.11\nnode.name = iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = \niface.ipaddress = \niface.prefix_len = 0\niface.hwaddress = \niface.transport_name = tcp\niface.initiatorname = \niface.state = \niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = \niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = \niface.subnet_mask = \niface.gateway = \niface.dhcp_alt_client_id_state = \niface.dhcp_alt_client_id = \niface.dhcp_dns = \niface.dhcp_learn_iqn = \niface.dhcp_req_vendor_id_state = \niface.dhcp_vendor_id_state = \niface.dhcp_vendor_id = \niface.dhcp_slp_da = \niface.fragmentation = \niface.gratuitous_arp = \niface.incoming_forwarding = \niface.tos_state = \niface.tos = 0\niface.ttl = 0\niface.delayed_ack = \niface.tcp_nagle = \niface.tcp_wsf_state = \niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = \niface.redirect = \niface.def_task_mgmt_timeout = 0\niface.header_digest = \niface.data_digest = \niface.immediate_data = \niface.initial_r2t = \niface.data_seq_inorder = \niface.data_pdu_inorder = \niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = \niface.bidi_chap = \niface.strict_login_compliance = \niface.discovery_auth = \niface.discovery_logout = \nnode.discovery_address = \nnode.discovery_port = 0\nnode.discovery_type = fw\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = 0\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = None\nnode.session.auth.username = \nnode.session.auth.password = \nnode.session.auth.username_in = \nnode.session.auth.password_in = \nnode.session.auth.chap_algs = SHA3-256,SHA256\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = auto\nnode.session.reopen_max = 0\nnode.session.conn_reopen_log_freq = 1\nnode.conn[0].address = 38.102.83.245\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm (): stdout=# BEGIN RECORD 6.2.1.11 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.name = iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.tpgt = -1 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.startup = automatic Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.leading_login = No Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.iscsi_ifacename = default Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.net_ifacename = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.ipaddress = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.prefix_len = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.hwaddress = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.transport_name = tcp Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.initiatorname = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.vlan_id = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.vlan_priority = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.vlan_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.iface_num = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.mtu = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.port = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.bootproto = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.subnet_mask = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.gateway = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_alt_client_id = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_dns = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_learn_iqn = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_req_vendor_id_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_vendor_id = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.dhcp_slp_da = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.fragmentation = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.gratuitous_arp = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.incoming_forwarding = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tos_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tos = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.ttl = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.delayed_ack = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tcp_nagle = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf_state = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tcp_wsf = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timer_scale = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.tcp_timestamp = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.redirect = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.def_task_mgmt_timeout = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.header_digest = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.data_digest = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.immediate_data = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.initial_r2t = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.data_seq_inorder = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.data_pdu_inorder = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.erl = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.max_receive_data_len = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.first_burst_len = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.max_outstanding_r2t = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.max_burst_len = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.chap_auth = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.bidi_chap = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.strict_login_compliance = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.discovery_auth = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: iface.discovery_logout = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.discovery_address = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.discovery_port = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.discovery_type = fw Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.initial_cmdsn = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.initial_login_retry_max = 8 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.xmit_thread_priority = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.cmds_max = 128 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.queue_depth = 32 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.nr_sessions = 1 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.authmethod = None Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password = *** Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.username_in = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.password_in = Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.auth.chap_algs = SHA3-256,SHA256 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.timeo.replacement_timeout = 120 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.abort_timeout = 15 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.lu_reset_timeout = 30 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.tgt_reset_timeout = 30 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.err_timeo.host_reset_timeout = 60 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FastAbort = Yes Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.InitialR2T = No Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ImmediateData = Yes Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.FirstBurstLength = 262144 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxBurstLength = 16776192 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Retain = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.DefaultTime2Wait = 2 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxConnections = 1 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.MaxOutstandingR2T = 1 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.iscsi.ERL = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.scan = auto Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.reopen_max = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.session.conn_reopen_log_freq = 1 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].address = 38.102.83.245 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].port = 3260 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].startup = manual Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.window_size = 524288 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].tcp.type_of_service = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.logout_timeout = 15 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.login_timeout = 15 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.auth_timeout = 45 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_interval = 5 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].timeo.noop_out_timeout = 5 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.HeaderDigest = None Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.DataDigest = None Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.IFMarker = No Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: node.conn[0].iscsi.OFMarker = No Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: # END RECORD Jan 22 10:32:45.707576 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.710345 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.scan -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.722243 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.013s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.722977 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8095205-69bc-4592-bdf4-6cf7b6b33289]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.723480 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.725940 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.738718 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.738942 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e8c08-71ab-43bd-8f4d-4e6f3f53b3b1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.739506 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.741080 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.username -v Dhs3jG7VaMWAorhLm9Ko {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.753795 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.username -v Dhs3jG7VaMWAorhLm9Ko" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.753990 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[396c1dd3-3853-479d-92e4-2defda7c8d40]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.754632 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Dhs3jG7VaMWAorhLm9Ko'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.755928 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.password -v *** {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.767707 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.767957 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d090463a-028b-473e-bbaa-36f15681c0ed]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.768594 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.769629 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.780239 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.780502 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6d8d4-3390-4a08-9546-87e69c8e293c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.780932 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jan 22 10:32:45.780932 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:32:45.781194 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jan 22 10:32:45.781194 np0005592324.novalocal cinder-backup[182863]: {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:32:45.781489 np0005592324.novalocal cinder-backup[182863]: WARNING os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jan 22 10:32:45.781489 np0005592324.novalocal cinder-backup[182863]: Jan 22 10:32:45.783895 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --login {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.806555 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --login" returned: 0 in 0.023s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.806816 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[319df137-604d-4677-ab36-b4c31695d2ee]: (4, ('Login to [iface: default, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.807366 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--login',): stdout=Login to [iface: default, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260] successful. Jan 22 10:32:45.807366 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.808557 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.startup -v automatic {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.822457 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.startup -v automatic" returned: 0 in 0.014s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.822730 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec26060f-13dd-42b7-9346-9b245e2d68db]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.823236 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:45.824426 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.837041 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.012s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.837371 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eceb5b-dfce-459c-9dfa-d5e96232b35c]: (4, ('tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.837829 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('-m', 'session'): stdout=tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash) Jan 22 10:32:45.837829 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:32:45.838084 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsi session list stdout=tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash) Jan 22 10:32:45.838084 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:32:45.838592 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_to_iscsi_portal-38.102.83.245:3260-iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:32:45.838852 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Connected to 38.102.83.245:3260 {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:659}} Jan 22 10:32:45.839563 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] HCTL ('2', '-', '-', 0) found on session 32 with lun 0 {{(pid=182863) get_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:810}} Jan 22 10:32:45.839858 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Scanning host 2 c: -, t: -, l: 0) {{(pid=182863) scan_iscsi /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:836}} Jan 22 10:32:45.876981 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host2/scan {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:45.909256 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host2/scan" returned: 0 in 0.032s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:45.909724 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33dc52-631e-4789-b1bb-a75c20ad360d]: (4, ('- - 0', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:45.910706 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Searching for a device in session 32 and hctl ['2', '*', '*', 0] yield: None {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:32:46.912634 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Searching for a device in session 32 and hctl ['2', '*', '*', 0] yield: sda {{(pid=182863) device_name_by_hctl /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:830}} Jan 22 10:32:46.913513 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Connected to sda using {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b', 'target_lun': 0, 'volume_id': 'a7bf7eee-1316-4568-a60a-35e7db4a004b', 'auth_method': 'CHAP', 'auth_username': 'Dhs3jG7VaMWAorhLm9Ko', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False} {{(pid=182863) _connect_vol /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:687}} Jan 22 10:32:46.914592 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.279s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:32:46.914918 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] <== connect_volume: return (2280ms) {'type': 'block', 'scsi_wwn': '36001405d21561da92cf4d3ebbef10fff', 'path': '/dev/sda'} {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:32:46.915587 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:46.954193 np0005592324.novalocal sudo[227533]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda Jan 22 10:32:47.310975 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1003 /dev/sda" returned: 0 in 0.395s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:47.319197 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:32:47.331802 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-866992664,backup: e92da556-5331-4f29-b060-5a3f0ad52431. {{(pid=182863) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:252}} Jan 22 10:32:47.480502 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] generate_object_name_prefix: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431 {{(pid=182863) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:433}} Jan 22 10:32:47.486515 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] starting backup of volume: a7bf7eee-1316-4568-a60a-35e7db4a004b, volume size: 1073741824, object names prefix volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431, availability zone: nova {{(pid=182863) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:362}} Jan 22 10:32:47.633700 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:47.764587 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:47.764692 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:47.895594 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:47.895825 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:48.294259 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:48.487482 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:48.487751 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:48.623247 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:48.623637 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:48.785921 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:48.912571 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:48.912842 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:49.115550 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:49.115655 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:49.370323 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:49.556646 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:49.556886 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:49.702434 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:49.702687 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:49.880620 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:50.041508 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:50.041683 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:50.191472 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:50.191698 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:50.357440 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:50.497976 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:50.498461 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:50.624731 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:50.624938 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:51.258550 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:51.386416 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:51.386603 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:51.591296 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:51.591296 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:51.772422 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:51.883998 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:51.884310 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:52.015275 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:52.015497 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:52.548873 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:52.678974 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:52.679739 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:52.818825 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:52.818929 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:52.963129 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:53.098817 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:53.098923 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:53.267378 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:53.267378 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:53.477255 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:53.666960 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:53.667432 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:53.818193 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:53.818519 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:53.996180 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:54.099131 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:54.099459 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:54.317035 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:54.317371 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:54.462803 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:54.561584 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:54.561884 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:54.722604 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:54.722972 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:55.087131 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:55.224095 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:55.224197 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:55.338411 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:55.338511 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:55.531916 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:55.703457 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:55.704247 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:55.843442 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:55.843764 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:56.031728 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:56.129640 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:56.131250 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:56.240900 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:56.241003 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:56.415335 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:56.585607 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:56.585607 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:56.741007 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:56.741333 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:57.072186 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:57.211450 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:57.211450 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:57.331939 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:57.332240 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:57.538812 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:57.635963 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:57.636134 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:57.739473 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:57.739473 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:58.138095 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:58.271043 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:58.271392 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:58.415433 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:58.415548 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:58.552061 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Backing up chunk of data from volume. {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jan 22 10:32:58.639097 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=182863) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:433}} Jan 22 10:32:58.639330 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] About to put_object {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:397}} Jan 22 10:32:58.742495 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup MD5 for volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:405}} Jan 22 10:32:58.742744 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Calling eventlet.sleep(0) {{(pid=182863) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:412}} Jan 22 10:32:58.749992 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Getting metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jan 22 10:32:58.758908 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=182863) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jan 22 10:32:58.759265 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Getting metadata type 'volume-metadata' {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jan 22 10:32:58.764608 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] No metadata type 'volume-metadata' available {{(pid=182863) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jan 22 10:32:58.764917 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Getting metadata type 'volume-glance-metadata' {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jan 22 10:32:58.769448 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.driver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] No metadata type 'volume-glance-metadata' available {{(pid=182863) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jan 22 10:32:58.769935 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-866992664, sha256file filename: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_sha256file. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:302}} Jan 22 10:32:58.856475 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] _write_sha256file finished. {{(pid=182863) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:318}} Jan 22 10:32:58.857185 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-866992664, metadata filename: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_metadata. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:279}} Jan 22 10:32:58.888790 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "e92da556-5331-4f29-b060-5a3f0ad52431",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-1729358917",\n "created_at": "2026-01-22 15:32:40+00:00",\n "objects": [\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a7bf7eee-1316-4568-a60a-35e7db4a004b",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a7bf7eee-1316-4568-a60a-35e7db4a004b\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"d7b8492286144293b2b4604f0e979d3c\\", \\"project_id\\": \\"844db69bbb744f37b147c986687d6963\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0005592324.novalocal@lvmdriver-1#lvmdriver-1\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-01-22T15:32:39.000000\\", \\"launched_at\\": \\"2026-01-22T15:32:39.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-1344327020\\", \\"display_description\\": null, \\"provider_location\\": \\"38.102.83.245:3260,iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b 0\\", \\"provider_auth\\": \\"CHAP Dhs3jG7VaMWAorhLm9Ko Aj5Foe7kvT572Yj2\\", \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"d32eda9a-7ff9-443b-adbb-d3691c157d72\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"771da135-eeed-4943-b6ea-b7776ef0771a\\", \\"shared_targets\\": false, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-01-22T15:32:39.000000\\", \\"updated_at\\": \\"2026-01-22T15:32:42.000000\\"}}"\n}'. {{(pid=182863) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:298}} Jan 22 10:32:58.892337 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] backup e92da556-5331-4f29-b060-5a3f0ad52431 finished. {{(pid=182863) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:465}} Jan 22 10:32:58.973338 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.009329 np0005592324.novalocal sudo[227543]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda Jan 22 10:32:59.344830 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sda" returned: 0 in 0.371s {{(pid=182863) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.346511 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_portal': '38.102.83.245:3260', 'target_iqn': 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b', 'target_lun': 0, 'volume_id': 'a7bf7eee-1316-4568-a60a-35e7db4a004b', 'auth_method': 'CHAP', 'auth_username': 'Dhs3jG7VaMWAorhLm9Ko', 'auth_password': '***', 'encrypted': False, 'qos_specs': None, 'access_mode': 'rw', 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '36001405d21561da92cf4d3ebbef10fff', 'path': '/dev/sda'}), 'kwargs': {'force': True}}" {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:177}} Jan 22 10:32:59.346790 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:68}} Jan 22 10:32:59.349004 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:73}} Jan 22 10:32:59.350971 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.359420 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.359770 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849364a-ee39-4849-a559-82b46980f139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b\n\tPortal: 38.102.83.245:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: iSNS: Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: STATIC: Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: Target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: Portal: 38.102.83.245:3260,-1 Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: Iface Name: default Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: FIRMWARE: Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: No targets found. Jan 22 10:32:59.360295 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:32:59.360579 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jan 22 10:32:59.360579 np0005592324.novalocal cinder-backup[182863]: .*?^DiscoveryAddress: 38.102.83.245,3260.*? Jan 22 10:32:59.360579 np0005592324.novalocal cinder-backup[182863]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=182863) _get_discoverydb_portals /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:392}} Jan 22 10:32:59.361059 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Getting connected devices for (ips,iqns,luns)=[('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b', 0)] {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:855}} Jan 22 10:32:59.365612 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.371509 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.009s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.371808 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d4047-c392-4d58-9885-d12a07b49575]: (4, ('38.102.83.245:3260,4294967295 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.372970 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.380809 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.008s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.380985 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0a19d9-bc8a-479b-851e-858c2b86394b]: (4, ('tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash)\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.381333 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('-m', 'session'): stdout=tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash) Jan 22 10:32:59.381333 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm_bare /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1223}} Jan 22 10:32:59.381471 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsi session list stdout=tcp: [32] 38.102.83.245:3260,1 iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b (non-flash) Jan 22 10:32:59.381471 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsi_session /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1212}} Jan 22 10:32:59.382270 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Resulting device map defaultdict(. at 0x7f3022c7bf60>, {('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b'): ({'sda'}, set())}) {{(pid=182863) _get_connection_devices /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:888}} Jan 22 10:32:59.382470 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Removing single pathed devices sda {{(pid=182863) remove_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:392}} Jan 22 10:32:59.383254 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.389317 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] 'multipathd show status' failed. Not Retrying. {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:423}} Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f75dcdeb-092b-4044-a054-dae600c941cf]: [Errno 2] No such file or directory: 'multipathd' {{(pid=207268) _process_cmd /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:492}} Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: Traceback (most recent call last): Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ret = func(*f_args, **f_kwargs) Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: return func(*args, **kwargs) Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs) Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: return putils.execute(on_execute=on_execute, Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: obj = subprocess.Popen(cmd, Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: ^^^^^^^^^^^^^^^^^^^^^ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__ Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: self._execute_child(args, executable, preexec_fn, close_fds, Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: raise child_exception_type(errno_num, err_msg, err_filename) Jan 22 10:32:59.390456 np0005592324.novalocal cinder-backup[182863]: FileNotFoundError: [Errno 2] No such file or directory: 'multipathd' Jan 22 10:32:59.391199 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dcdeb-092b-4044-a054-dae600c941cf]: (5, 'builtins.FileNotFoundError', (2, 'No such file or directory'), 'Traceback (most recent call last):\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 489, in _process_cmd\n ret = func(*f_args, **f_kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 270, in _wrap\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 198, in execute_root\n return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 146, in custom_execute\n return putils.execute(on_execute=on_execute,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py", line 354, in execute\n obj = subprocess.Popen(cmd,\n ^^^^^^^^^^^^^^^^^^^^^\n File "/usr/lib64/python3.12/subprocess.py", line 1026, in __init__\n self._execute_child(args, executable, preexec_fn, close_fds,\n File "/usr/lib64/python3.12/subprocess.py", line 1955, in _execute_child\n raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: \'multipathd\'\n') {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.391633 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Flushing IO for device /dev/sda {{(pid=182863) flush_device_io /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:463}} Jan 22 10:32:59.392378 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sda {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.399835 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sda" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.399990 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a665b061-b680-41f4-8f43-6a4c978f250c]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.400284 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Remove SCSI device /dev/sda with /sys/block/sda/device/delete {{(pid=182863) remove_scsi_device /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:151}} Jan 22 10:32:59.401031 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sda/device/delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.453883 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sda/device/delete" returned: 0 in 0.052s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.454184 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7fd7f7-d5c0-4c1d-95e2-9966507327bc]: (4, ('1', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.454755 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Checking to see if SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:159}} Jan 22 10:32:59.455068 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.linuxscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] SCSI volumes sda have been removed. {{(pid=182863) wait_for_volumes_removal /usr/local/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:169}} Jan 22 10:32:59.455714 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Disconnecting from: [('38.102.83.245:3260', 'iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b')] {{(pid=182863) _disconnect_connection /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1201}} Jan 22 10:32:59.457792 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.startup -v manual {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.464894 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op update -n node.startup -v manual" returned: 0 in 0.007s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.465289 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[64984a67-4fb9-44c6-acbb-8876347f98c1]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.465708 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:59.466840 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --logout {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.492902 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --logout" returned: 0 in 0.026s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.493186 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f34ad6-d4f7-4081-8ae9-36e92861c842]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260] successful.\n', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.493750 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260] Jan 22 10:32:59.493750 np0005592324.novalocal cinder-backup[182863]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b, portal: 38.102.83.245,3260] successful. Jan 22 10:32:59.493750 np0005592324.novalocal cinder-backup[182863]: stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:59.495098 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op delete {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:349}} Jan 22 10:32:59.505592 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:volume-a7bf7eee-1316-4568-a60a-35e7db4a004b -p 38.102.83.245:3260 --op delete" returned: 0 in 0.010s {{(pid=207268) execute /usr/local/lib/python3.12/site-packages/oslo_concurrency/processutils.py:372}} Jan 22 10:32:59.505882 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo.privsep.daemon [-] privsep: reply[066eec22-c21c-4cfc-a1ca-8946e1820a37]: (4, ('', '')) {{(pid=207268) _call_back /usr/local/lib/python3.12/site-packages/oslo_privsep/daemon.py:515}} Jan 22 10:32:59.506459 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=182863) _run_iscsiadm /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1067}} Jan 22 10:32:59.507009 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.base [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.159s {{(pid=182863) inner /usr/local/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:87}} Jan 22 10:32:59.507343 np0005592324.novalocal cinder-backup[182863]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] <== disconnect_volume: return (160ms) None {{(pid=182863) trace_logging_wrapper /usr/local/lib/python3.12/site-packages/os_brick/utils.py:204}} Jan 22 10:33:03.043858 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-67a8463f-0c40-4a83-9d20-dc074ffd9c5a tempest-VolumesBackupsV39Test-888539772 None] Create backup finished. backup: e92da556-5331-4f29-b060-5a3f0ad52431. Jan 22 10:33:03.510818 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] Delete backup started, backup: e92da556-5331-4f29-b060-5a3f0ad52431. Jan 22 10:33:03.512999 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] Using swift URL https://38.102.83.245:8080/v1/AUTH_844db69bbb744f37b147c986687d6963 {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:286}} Jan 22 10:33:03.513305 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.drivers.swift [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] Connect to https://38.102.83.245:8080/v1/AUTH_ in "per_user" mode {{(pid=182863) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:287}} Jan 22 10:33:03.513629 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] delete started, backup: e92da556-5331-4f29-b060-5a3f0ad52431, container: tempest-volumesbackupsv39test-backup-container-866992664, prefix: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:844}} Jan 22 10:33:03.580891 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] generated object list: ['volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00001', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00002', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00003', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00004', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00005', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00006', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00007', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00008', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00009', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00010', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00011', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00012', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00013', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00014', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00015', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00016', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00017', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00018', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00019', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00020', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00021', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_metadata', 'volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_sha256file']. {{(pid=182863) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:263}} Jan 22 10:33:03.613293 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00001 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.644293 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00002 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.672049 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00003 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.707578 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00004 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.735772 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00005 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.766872 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00006 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.791680 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00007 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.812852 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00008 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.838855 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00009 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.865081 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00010 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.890609 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00011 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.915557 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00012 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.933782 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00013 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.955826 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00014 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:03.983467 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00015 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.007896 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00016 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.032608 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00017 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.060796 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00018 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.099361 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00019 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.134204 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00020 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.166076 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431-00021 in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.200246 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_metadata in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.236279 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] deleted object: volume_a7bf7eee-1316-4568-a60a-35e7db4a004b/20260122153247/az_nova_backup_e92da556-5331-4f29-b060-5a3f0ad52431_sha256file in container: tempest-volumesbackupsv39test-backup-container-866992664. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:860}} Jan 22 10:33:04.236658 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.backup.chunkeddriver [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] delete e92da556-5331-4f29-b060-5a3f0ad52431 finished. {{(pid=182863) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:870}} Jan 22 10:33:04.242073 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_db.sqlalchemy.engines [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=182863) _check_effective_sql_mode /usr/local/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jan 22 10:33:04.270145 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.quota [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] Created reservations ['d0cf0917-6895-4d7d-a039-88692ab9a0d1', '87cf7281-e818-416a-b584-77f962300e5b'] {{(pid=182863) reserve /opt/stack/cinder/cinder/quota.py:752}} Jan 22 10:33:04.288013 np0005592324.novalocal cinder-backup[182863]: INFO cinder.backup.manager [None req-0aef6b75-bc6b-4f9b-8e9e-26a2267421c7 tempest-VolumesBackupsV39Test-888539772 None] Delete backup finished, backup e92da556-5331-4f29-b060-5a3f0ad52431 deleted. Jan 22 10:33:14.287052 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=38,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:33:30.919993 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:33:30.920576 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:34:19.891495 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:34:30.916062 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:34:30.916644 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:35:30.921848 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:35:30.921848 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:36:19.891351 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:36:30.926383 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:36:30.926829 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:37:30.930861 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:37:30.931590 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:38:19.889975 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:38:30.928598 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:38:30.929156 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:39:30.932574 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:39:30.933104 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:40:19.889692 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:40:30.936794 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:40:30.937583 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:41:30.933032 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:41:30.933497 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:42:19.889833 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:42:30.937776 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:42:30.938490 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:43:30.943408 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:43:30.943979 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:44:19.891347 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:44:30.947574 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:44:30.948113 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:45:30.944466 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:45:30.945124 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:46:19.890108 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:46:30.949997 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:46:30.950610 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:47:30.953237 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:47:30.953744 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 22 10:48:19.889299 np0005592324.novalocal cinder-backup[182863]: DEBUG dbcounter [-] [182863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=182863) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Jan 22 10:48:30.957673 np0005592324.novalocal cinder-backup[182863]: DEBUG oslo_service.periodic_task [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=182863) run_periodic_tasks /usr/local/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jan 22 10:48:30.958289 np0005592324.novalocal cinder-backup[182863]: DEBUG cinder.manager [None req-38c5b14a-9399-4e54-b236-6a0cf88f061a None None] Notifying Schedulers of capabilities ... {{(pid=182863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}