Nov 24 14:26:45.395968 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c421c4c1-a626-428c-88ed-70ec173dba54, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-30a200ac-8aa1-493c-9cf3-26c56cc16f4a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-5cf1e1cf-f421-4fa9-9bd7-572179d7eb07', 'neutron:subnet_ids': '2e513594-1102-488c-8052-c722c7db208b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:de:84:fc', name='lrp-ca2338b8-4d45-44f6-a4eb-036177388c7b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:45.403585 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-30a200ac-8aa1-493c-9cf3-26c56cc16f4a, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5cf1e1cf-f421-4fa9-9bd7-572179d7eb07 Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:45.927896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:26:45.928400 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:26:45.928400 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5cf1e1cf-f421-4fa9-9bd7-572179d7eb07 Nov 24 14:26:45.928400 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:26:50.106116 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23d48cf5-3e05-4e00-8507-28ed9bc5aaf2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[75776da2-ae2b-4b35-9377-d7b92348f3a5], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:23:2f:2f', name='lrp-d89ac47f-1c62-4244-836f-42215b50b5ee', networks=['172.24.5.91/24', '2001:db8::246/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:51.076150 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=90a2872d-f4b1-44ff-9de8-bf5577f28a43, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-243d3875-c938-4430-a726-bbbefddd4e26', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ab3b14a2-c272-483b-8e99-dc32e75e3da9', 'neutron:subnet_ids': 'b4c950a2-09cd-44e2-9a85-27827574e971'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:52:c3:67', name='lrp-9b7201a5-0d9f-488b-9e6d-e71aa133bd2d', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:51.080626 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-243d3875-c938-4430-a726-bbbefddd4e26, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:51.902116 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d6e30321-f581-4967-9e7e-424d7b559d1d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a58930b3-ecb4-48e0-8948-e1a236e637fd', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-20d0c2ac-30b4-453e-b79c-1a385a687de1', 'neutron:subnet_ids': 'd684269a-3b5d-4539-a8b4-0e9013fe0379'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ec:a0:33', name='lrp-e1e385c5-945c-4630-858b-f46bef45bf24', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:51.904469 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-a58930b3-ecb4-48e0-8948-e1a236e637fd, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ab3b14a2-c272-483b-8e99-dc32e75e3da9 Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:52.529140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:26:52.529749 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:26:52.529749 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ab3b14a2-c272-483b-8e99-dc32e75e3da9 Nov 24 14:26:52.529749 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-20d0c2ac-30b4-453e-b79c-1a385a687de1 Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:26:53.035095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:26:53.036055 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:26:53.036055 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-20d0c2ac-30b4-453e-b79c-1a385a687de1 Nov 24 14:26:53.036055 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:26:53.894041 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=84899768-08ba-4208-813b-073ef82a479b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b', 'neutron:subnet_ids': '12c64cdc-e585-4e00-bcbb-dc4cbf749e70'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:44:3c:e0', name='lrp-d4d7e1f3-c475-466d-af4a-421b3be35d80', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:53.977593 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:26:53.978165 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '8dfc01cd-90a2-4cd2-b3f3-16a7ed096824', 'neutron:router_id': '7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:53.978507 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:56.853950 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=2f5e5241-a70e-4509-b7bd-e76f87f362ee, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6d13fb14-87b6-4b3e-ac0d-5a0517bd1803', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[0680bb36-f102-4c74-b78a-5e5290f96e11], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:06:60:17', name='lrp-4c19b1f6-9945-4f5c-a7fe-82fed43dd13d', networks=['172.24.5.115/24', '2001:db8::1b2/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:58.834365 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ae67f1b2-f279-4d57-bee3-67e064055cef, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-066084e5-6cda-4f15-9052-50176bd6486a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6d13fb14-87b6-4b3e-ac0d-5a0517bd1803', 'neutron:subnet_ids': '56d7667d-3f13-4843-abf3-58ae0942c96d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:25:26:ea', name='lrp-29159b07-4852-45c0-a043-179406f435ee', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:26:58.883424 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-066084e5-6cda-4f15-9052-50176bd6486a synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:26:58.884825 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-066084e5-6cda-4f15-9052-50176bd6486a, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '066084e5-6cda-4f15-9052-50176bd6486a', 'neutron:router_id': '6d13fb14-87b6-4b3e-ac0d-5a0517bd1803'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:26:58.885115 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-066084e5-6cda-4f15-9052-50176bd6486a, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:27:08.881582 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:27:43.166094 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b15db20f-5d03-4272-a248-440636f4a9e4, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a92b61f5-d335-4f50-9330-d10fb7279581', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[4f7b24cf-f90b-44c7-af8b-11a6421a218b], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c6:0a:d7', name='lrp-d9dcb176-8192-475f-b7e9-8bd1697420b4', networks=['172.24.5.235/24', '2001:db8::324/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:27:44.970564 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5f3f3049-28d9-41fa-8556-9895052d30a5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-76022d51-79c9-4e9c-a137-212ad56497fb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a92b61f5-d335-4f50-9330-d10fb7279581', 'neutron:subnet_ids': '13915700-4206-45d9-bdfd-69b8458b1b6c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:13:99:51', name='lrp-58657941-14eb-46c6-b851-2f66d3185f21', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:27:45.019318 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-76022d51-79c9-4e9c-a137-212ad56497fb synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:27:45.021116 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-76022d51-79c9-4e9c-a137-212ad56497fb, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '76022d51-79c9-4e9c-a137-212ad56497fb', 'neutron:router_id': 'a92b61f5-d335-4f50-9330-d10fb7279581'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:27:45.021665 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-76022d51-79c9-4e9c-a137-212ad56497fb, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:27:55.020914 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:28:11.169771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ae67f1b2-f279-4d57-bee3-67e064055cef, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-066084e5-6cda-4f15-9052-50176bd6486a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-6d13fb14-87b6-4b3e-ac0d-5a0517bd1803', 'neutron:subnet_ids': '56d7667d-3f13-4843-abf3-58ae0942c96d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:25:26:ea', name='lrp-29159b07-4852-45c0-a043-179406f435ee', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:28:11.170823 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-066084e5-6cda-4f15-9052-50176bd6486a, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-6d13fb14-87b6-4b3e-ac0d-5a0517bd1803 Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:11.765232 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:28:11.765463 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:28:11.765463 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-6d13fb14-87b6-4b3e-ac0d-5a0517bd1803 Nov 24 14:28:11.765463 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:28:15.115108 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a45ad8fe-457c-4c3e-8e67-130a776557e0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-036c3f98-6292-4a9f-84bd-d19936ffd678', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[ea1418fc-7098-477c-a7ba-735ce5a7b9e1], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:55:c3:31', name='lrp-000ffc04-b376-440d-982f-97782ac506a9', networks=['172.24.5.102/24', '2001:db8::3a3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:28:16.999677 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a291b57b-864d-4043-8b18-c0d42df7f4dc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-036c3f98-6292-4a9f-84bd-d19936ffd678', 'neutron:subnet_ids': '6e410b42-e21d-4245-85c8-7f455de961b1'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:08:8c:f2', name='lrp-91cb1cb3-0add-4309-b63f-27eca2043fe2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:28:17.042668 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:28:17.043197 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '77410536-2ca8-41d0-bb5d-f09a308d64e1', 'neutron:router_id': '036c3f98-6292-4a9f-84bd-d19936ffd678'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:28:17.043383 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:28:27.040694 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:28:54.867118 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a291b57b-864d-4043-8b18-c0d42df7f4dc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-036c3f98-6292-4a9f-84bd-d19936ffd678', 'neutron:subnet_ids': '6e410b42-e21d-4245-85c8-7f455de961b1'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:08:8c:f2', name='lrp-91cb1cb3-0add-4309-b63f-27eca2043fe2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:28:54.873540 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-77410536-2ca8-41d0-bb5d-f09a308d64e1, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-036c3f98-6292-4a9f-84bd-d19936ffd678 Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:28:55.349267 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:28:55.349856 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:28:55.349856 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-036c3f98-6292-4a9f-84bd-d19936ffd678 Nov 24 14:28:55.349856 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:29:12.158648 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=412dc1e4-f6e7-49d3-8caf-f5131d4e7652, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-d392b515-206f-403c-af3a-ccd2cf799beb', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-f4e82fb9-2795-4337-a94c-7789eb6d30a2', 'neutron:subnet_ids': 'b7e43204-bd6e-4104-a584-09749ad92b12'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:2b:5d:5a', name='lrp-b2131c7f-40ca-4556-a4cc-51adf0445289', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:12.161596 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-d392b515-206f-403c-af3a-ccd2cf799beb, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f4e82fb9-2795-4337-a94c-7789eb6d30a2 Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:12.665718 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:29:12.665972 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:29:12.665972 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f4e82fb9-2795-4337-a94c-7789eb6d30a2 Nov 24 14:29:12.665972 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:29:15.899918 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=11771708-8f50-4b45-83e6-377ca272e37f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-83583216-9232-456a-bf22-00eb4c65f8a6', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[c7b9499c-350f-424f-ab62-59bd3c431b8b], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:a0:d0:b7', name='lrp-e1c7c5c3-6d1a-4895-9bf7-a687e5b70093', networks=['172.24.5.30/24', '2001:db8::328/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:17.031332 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=08ccc683-3a14-41ed-9109-f8b229c66eff, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-83583216-9232-456a-bf22-00eb4c65f8a6', 'neutron:subnet_ids': '8675e51d-3a3a-4494-8dcb-d3f6d8fba2a9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:63:7b:77', name='lrp-1d629573-31eb-432c-9aa6-2f2c328a00e2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:17.074024 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:29:17.074646 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'f1822f4b-4295-483f-90c5-6e315c5c2e46', 'neutron:router_id': '83583216-9232-456a-bf22-00eb4c65f8a6'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:17.074978 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:27.073296 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:29:40.267656 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=84899768-08ba-4208-813b-073ef82a479b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b', 'neutron:subnet_ids': '12c64cdc-e585-4e00-bcbb-dc4cbf749e70'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:44:3c:e0', name='lrp-d4d7e1f3-c475-466d-af4a-421b3be35d80', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:40.267656 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-8dfc01cd-90a2-4cd2-b3f3-16a7ed096824, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:40.894583 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=08ccc683-3a14-41ed-9109-f8b229c66eff, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-83583216-9232-456a-bf22-00eb4c65f8a6', 'neutron:subnet_ids': '8675e51d-3a3a-4494-8dcb-d3f6d8fba2a9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:63:7b:77', name='lrp-1d629573-31eb-432c-9aa6-2f2c328a00e2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:40.902577 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-f1822f4b-4295-483f-90c5-6e315c5c2e46, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:40.942831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:29:40.943229 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:29:40.943229 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-7e1be7dc-ff65-4a43-82df-8fe8bd6ce77b Nov 24 14:29:40.943229 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-83583216-9232-456a-bf22-00eb4c65f8a6 Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:29:41.381130 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:29:41.382049 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:29:41.382049 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-83583216-9232-456a-bf22-00eb4c65f8a6 Nov 24 14:29:41.382049 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:29:44.873112 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f6e8d242-0a4d-47b8-939e-c69b88b2a005, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec21a8e9-d073-464a-a429-ee817af5350e', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[075dcce9-e87c-436f-ae57-28b4dd75938f], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:8a:92:e3', name='lrp-8d541fe7-f113-4a72-a1ab-521fc8592d12', networks=['172.24.5.26/24', '2001:db8::1f9/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:46.255526 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=47e2ea7f-f6dc-41fd-b575-5b0fc747ceae, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-94558056-9679-4a98-9fce-ba49bb1d9084', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[b80b8ea1-812b-4495-8ba9-aaf98e6eb2ad], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:39:f4:d3', name='lrp-7b98ad17-3923-42f3-ba7f-2e74e5ff3210', networks=['172.24.5.174/24', '2001:db8::347/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:46.351723 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8ba182eb-2d43-46cd-93da-92c4e6a47e4b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b67bed11-2428-4fed-97e1-01c633f93fde', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec21a8e9-d073-464a-a429-ee817af5350e', 'neutron:subnet_ids': '1ec3f123-90bf-4ed0-be98-9969514cf3e5'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:76:fb:79', name='lrp-fc4956d1-d1af-456a-8571-a5510bfa456a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:46.385792 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-b67bed11-2428-4fed-97e1-01c633f93fde synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:29:46.386399 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-b67bed11-2428-4fed-97e1-01c633f93fde, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'b67bed11-2428-4fed-97e1-01c633f93fde', 'neutron:router_id': 'ec21a8e9-d073-464a-a429-ee817af5350e'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:46.386666 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-b67bed11-2428-4fed-97e1-01c633f93fde, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:49.409402 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=42671020-dce5-4b23-a6eb-c901f6eebb4e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-94558056-9679-4a98-9fce-ba49bb1d9084', 'neutron:subnet_ids': '60e32ebb-7df4-478d-a020-622d2bd692f9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ff:3b:79', name='lrp-03f0ee46-4374-451d-931c-7f83079e3a28', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:29:49.465177 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:29:49.465177 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd', 'neutron:router_id': '94558056-9679-4a98-9fce-ba49bb1d9084'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:49.465177 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:29:59.464670 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:30:10.596289 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8ba182eb-2d43-46cd-93da-92c4e6a47e4b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b67bed11-2428-4fed-97e1-01c633f93fde', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ec21a8e9-d073-464a-a429-ee817af5350e', 'neutron:subnet_ids': '1ec3f123-90bf-4ed0-be98-9969514cf3e5'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:76:fb:79', name='lrp-fc4956d1-d1af-456a-8571-a5510bfa456a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:10.601258 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-b67bed11-2428-4fed-97e1-01c633f93fde, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ec21a8e9-d073-464a-a429-ee817af5350e Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:11.256771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:30:11.257608 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:30:11.257608 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ec21a8e9-d073-464a-a429-ee817af5350e Nov 24 14:30:11.257608 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:30:37.214418 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=42671020-dce5-4b23-a6eb-c901f6eebb4e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-94558056-9679-4a98-9fce-ba49bb1d9084', 'neutron:subnet_ids': '60e32ebb-7df4-478d-a020-622d2bd692f9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ff:3b:79', name='lrp-03f0ee46-4374-451d-931c-7f83079e3a28', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:37.215956 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-fbbe17c4-eb1c-4a45-9ded-44bcc21f35dd, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-94558056-9679-4a98-9fce-ba49bb1d9084 Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:38.100017 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:30:38.101536 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:30:38.101536 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-94558056-9679-4a98-9fce-ba49bb1d9084 Nov 24 14:30:38.101536 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:30:39.299838 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8b22f609-76ff-444a-be65-3fc7a855c20b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5ab1b0dd-710b-448e-b801-fda74b14e96a', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[eeba483a-3cf1-484f-a8d4-e90e68ae21ee], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:80:4d:24', name='lrp-3f91bebd-5b79-420c-b77c-e03a48690119', networks=['172.24.5.230/24', '2001:db8::20/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:40.805888 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9938f831-ea61-4874-be2e-b02a484d760c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4a43731a-2821-4871-86bb-0f2217c60e4e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5ab1b0dd-710b-448e-b801-fda74b14e96a', 'neutron:subnet_ids': '5788a349-4b9c-438a-8a75-02f8f0e33647'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fe:24:cc', name='lrp-636aa383-7497-43a7-8833-6244fd9e2758', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:40.847482 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-4a43731a-2821-4871-86bb-0f2217c60e4e synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:30:40.849236 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-4a43731a-2821-4871-86bb-0f2217c60e4e, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '4a43731a-2821-4871-86bb-0f2217c60e4e', 'neutron:router_id': '5ab1b0dd-710b-448e-b801-fda74b14e96a'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:40.849764 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-4a43731a-2821-4871-86bb-0f2217c60e4e, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:42.088152 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9938f831-ea61-4874-be2e-b02a484d760c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4a43731a-2821-4871-86bb-0f2217c60e4e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5ab1b0dd-710b-448e-b801-fda74b14e96a', 'neutron:subnet_ids': '5788a349-4b9c-438a-8a75-02f8f0e33647'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fe:24:cc', name='lrp-636aa383-7497-43a7-8833-6244fd9e2758', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:42.091828 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-4a43731a-2821-4871-86bb-0f2217c60e4e, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5ab1b0dd-710b-448e-b801-fda74b14e96a Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:30:43.082083 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:30:43.083072 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:30:43.083072 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5ab1b0dd-710b-448e-b801-fda74b14e96a Nov 24 14:30:43.083072 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:30:46.822396 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b41e0aec-2359-4098-8f54-80730d31f38e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ca6a498f-e09d-4d84-aeb8-0fb732805312', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[3a3e24a6-720a-4e8d-bf9c-91964e2750af], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:93:a8:fd', name='lrp-46a9417e-3853-47e4-9f06-b2d857d40ae3', networks=['172.24.5.189/24', '2001:db8::3ab/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:49.196797 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9777b053-7e0a-44dc-94ba-ea3cc92d08a2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1558d895-95ff-4b91-af49-c0f24b5343f9', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ca6a498f-e09d-4d84-aeb8-0fb732805312', 'neutron:subnet_ids': 'e3308c8a-7110-4a43-a468-c5bcd0ce9085'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c6:65:2f', name='lrp-52c472e1-d20d-4b41-9583-c111e3f3ea4a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:30:49.256380 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-1558d895-95ff-4b91-af49-c0f24b5343f9 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:30:49.257703 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-1558d895-95ff-4b91-af49-c0f24b5343f9, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '1558d895-95ff-4b91-af49-c0f24b5343f9', 'neutron:router_id': 'ca6a498f-e09d-4d84-aeb8-0fb732805312'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:49.258169 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-1558d895-95ff-4b91-af49-c0f24b5343f9, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:30:59.258999 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:31:11.368990 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:31:11.381081 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:31:11.381287 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, security_groups=1, routers=1, router_ports=1 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:31:11.381482 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Number of inconsistencies found at delete: router_ports=12 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:31:11.381671 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 76022d51-79c9-4e9c-a137-212ad56497fb (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:31:11.449977 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-76022d51-79c9-4e9c-a137-212ad56497fb, resource={'id': '76022d51-79c9-4e9c-a137-212ad56497fb', 'name': 'tempest-AttachVolumeMultiAttachTest-1698436059-network', 'tenant_id': 'b8c5afe0783b4a2e8465ddb625847eac', 'project_id': 'b8c5afe0783b4a2e8465ddb625847eac', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['13915700-4206-45d9-bdfd-69b8458b1b6c'], 'standard_attr_id': 751, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:27:41Z', 'updated_at': '2025-11-24T19:27:41Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 32063}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.449977 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-76022d51-79c9-4e9c-a137-212ad56497fb, col_values=(('external_ids', {'neutron:network_name': 'tempest-AttachVolumeMultiAttachTest-1698436059-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.450093 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f2d2750c-4b95-47e3-9c5d-0215d76897db, external_ids_update=None, columns={'tag': 32063}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.479456 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Successfully bumped revision number for resource 76022d51-79c9-4e9c-a137-212ad56497fb (type: networks) to 2 Nov 24 14:31:11.479797 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 8bbb736c-56d6-44ec-a6ad-b34ed9f54c07 (type: security_groups) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:31:11.513244 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Successfully bumped revision number for resource 8bbb736c-56d6-44ec-a6ad-b34ed9f54c07 (type: security_groups) to 3 Nov 24 14:31:11.513391 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource a92b61f5-d335-4f50-9330-d10fb7279581 (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:31:11.611407 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a92b61f5-d335-4f50-9330-d10fb7279581, resource={'id': 'a92b61f5-d335-4f50-9330-d10fb7279581', 'name': 'tempest-AttachVolumeMultiAttachTest-1698436059-router', 'tenant_id': 'b8c5afe0783b4a2e8465ddb625847eac', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.235'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::324'}], 'enable_snat': True}, 'gw_port_id': 'd9dcb176-8192-475f-b7e9-8bd1697420b4', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.235', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::324', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:27:42Z', 'updated_at': '2025-11-24T19:27:44Z', 'revision_number': 3, 'project_id': 'b8c5afe0783b4a2e8465ddb625847eac'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.613026 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-a92b61f5-d335-4f50-9330-d10fb7279581, columns={'external_ids': {'neutron:router_name': 'tempest-AttachVolumeMultiAttachTest-1698436059-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.613026 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "d9dcb176-8192-475f-b7e9-8bd1697420b4"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.613026 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "d9dcb176-8192-475f-b7e9-8bd1697420b4"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.672694 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Successfully bumped revision number for resource a92b61f5-d335-4f50-9330-d10fb7279581 (type: routers) to 3 Nov 24 14:31:11.672850 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource d9dcb176-8192-475f-b7e9-8bd1697420b4 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:31:11.832149 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-d9dcb176-8192-475f-b7e9-8bd1697420b4, resource={'id': 'd9dcb176-8192-475f-b7e9-8bd1697420b4', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:c6:0a:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a92b61f5-d335-4f50-9330-d10fb7279581', 'device_owner': 'network:router_gateway', 'standard_attr_id': 756, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.235'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::324'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:27:42Z', 'updated_at': '2025-11-24T19:27:44Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.832401 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-d9dcb176-8192-475f-b7e9-8bd1697420b4, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-a92b61f5-d335-4f50-9330-d10fb7279581'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::324/64', '172.24.5.235/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.832401 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=d9dcb176-8192-475f-b7e9-8bd1697420b4, lrouter_port=lrp-d9dcb176-8192-475f-b7e9-8bd1697420b4, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:11.865645 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Successfully bumped revision number for resource d9dcb176-8192-475f-b7e9-8bd1697420b4 (type: router_ports) to 5 Nov 24 14:31:11.865645 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 000ffc04-b376-440d-982f-97782ac506a9 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.865936 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(000ffc04-b376-440d-982f-97782ac506a9) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.872517 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource d89ac47f-1c62-4244-836f-42215b50b5ee (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.872774 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(d89ac47f-1c62-4244-836f-42215b50b5ee) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.881591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource c9cf3440-078c-48de-baf6-be5aa4f4b9f3 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.881591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(c9cf3440-078c-48de-baf6-be5aa4f4b9f3) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.893455 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 8d541fe7-f113-4a72-a1ab-521fc8592d12 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.893455 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(8d541fe7-f113-4a72-a1ab-521fc8592d12) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.898043 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 84286f41-dfe5-4247-b0b4-c8b2e53a4ad4 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.898216 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(84286f41-dfe5-4247-b0b4-c8b2e53a4ad4) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.904780 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 7b98ad17-3923-42f3-ba7f-2e74e5ff3210 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.904881 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(7b98ad17-3923-42f3-ba7f-2e74e5ff3210) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.910553 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 4c19b1f6-9945-4f5c-a7fe-82fed43dd13d (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.910734 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(4c19b1f6-9945-4f5c-a7fe-82fed43dd13d) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.921250 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 4607ae74-5c4b-4f5b-90e5-cbafa5cdaf3a (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.921250 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(4607ae74-5c4b-4f5b-90e5-cbafa5cdaf3a) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.932108 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 3f91bebd-5b79-420c-b77c-e03a48690119 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.932280 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(3f91bebd-5b79-420c-b77c-e03a48690119) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.940165 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 30d069dc-6a45-42e9-80c4-f8b5ded01625 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.940337 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(30d069dc-6a45-42e9-80c4-f8b5ded01625) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.946870 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 23998fe2-0a92-4c04-bd9e-f12c60f9190b (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.947027 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(23998fe2-0a92-4c04-bd9e-f12c60f9190b) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.950620 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource e1c7c5c3-6d1a-4895-9bf7-a687e5b70093 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:31:11.950780 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(e1c7c5c3-6d1a-4895-9bf7-a687e5b70093) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:31:11.954223 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Synchronization completed (took 0.57 seconds) Nov 24 14:31:13.936988 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9777b053-7e0a-44dc-94ba-ea3cc92d08a2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1558d895-95ff-4b91-af49-c0f24b5343f9', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ca6a498f-e09d-4d84-aeb8-0fb732805312', 'neutron:subnet_ids': 'e3308c8a-7110-4a43-a468-c5bcd0ce9085'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c6:65:2f', name='lrp-52c472e1-d20d-4b41-9583-c111e3f3ea4a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:13.938073 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-1558d895-95ff-4b91-af49-c0f24b5343f9, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ca6a498f-e09d-4d84-aeb8-0fb732805312 Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:14.579874 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:31:14.580755 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:31:14.580755 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ca6a498f-e09d-4d84-aeb8-0fb732805312 Nov 24 14:31:14.580755 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:31:18.361756 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6bfc71f2-8cd6-4a26-9c19-53cdadb89983, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b4348b8c-7087-45e7-88e2-a4e5941da87a', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[0bb64a83-ad2f-4c58-9c57-fe8621a82e73], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b9:f9:e5', name='lrp-a1a10d07-ad1f-4164-a4f7-1ef5706a5e54', networks=['172.24.5.195/24', '2001:db8::39b/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:20.059687 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23c3de50-64b0-4590-9949-b38ed6e5d474, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b4348b8c-7087-45e7-88e2-a4e5941da87a', 'neutron:subnet_ids': 'dd36a7e0-80da-48a3-807f-34b315e284da'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c3:c2:c7', name='lrp-a3e0e68e-860c-4837-a1b9-2fd5b3a01db0', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:20.096918 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:31:20.097453 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '415d9800-24c9-46f0-95ef-6c0f6d53732e', 'neutron:router_id': 'b4348b8c-7087-45e7-88e2-a4e5941da87a'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:20.097822 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:30.096157 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=228,neutron:UPDATE=4,neutron:DELETE=12 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:31:39.511485 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=486c48aa-e1f8-4106-b0c4-3372adae9eb7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f80f3610-61c9-4e0f-acae-3b84d986f48f', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-e769146b-cfb9-4559-b6e9-ff28ad543034', 'neutron:subnet_ids': '54d477b9-58d8-40f2-bbea-1c56d99ce1bc'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3b:86:fe', name='lrp-e3969d86-2be2-4124-9bb6-2c18bb047c31', networks=['10.1.0.5/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:40.179877 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=486c48aa-e1f8-4106-b0c4-3372adae9eb7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f80f3610-61c9-4e0f-acae-3b84d986f48f', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-e769146b-cfb9-4559-b6e9-ff28ad543034', 'neutron:subnet_ids': '54d477b9-58d8-40f2-bbea-1c56d99ce1bc'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3b:86:fe', name='lrp-e3969d86-2be2-4124-9bb6-2c18bb047c31', networks=['10.1.0.5/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:43.794393 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23c3de50-64b0-4590-9949-b38ed6e5d474, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-b4348b8c-7087-45e7-88e2-a4e5941da87a', 'neutron:subnet_ids': 'dd36a7e0-80da-48a3-807f-34b315e284da'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c3:c2:c7', name='lrp-a3e0e68e-860c-4837-a1b9-2fd5b3a01db0', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:31:43.798659 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-415d9800-24c9-46f0-95ef-6c0f6d53732e, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b4348b8c-7087-45e7-88e2-a4e5941da87a Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:31:44.256114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:31:44.256533 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:31:44.256533 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b4348b8c-7087-45e7-88e2-a4e5941da87a Nov 24 14:31:44.256533 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:32:54.292824 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d3d584aa-5d07-4a0b-8e7f-f1e764765578, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-217e011a-b084-4e61-a5f2-74fae1ee978c', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[b6e715fd-ae7d-49bc-add7-17021ab36039], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ed:8b:63', name='lrp-31488eb8-218d-4006-9635-87c4e1fac35f', networks=['172.24.5.59/24', '2001:db8::3ec/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:32:57.051032 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=33e49fbb-17c0-4cb8-8b0e-c819a8695797, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-217e011a-b084-4e61-a5f2-74fae1ee978c', 'neutron:subnet_ids': '66a97765-51f2-462b-b226-70bbb11d7223'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1b:01:80', name='lrp-6054f921-9e0a-42ee-a4ff-59064b28478c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:32:57.096152 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:32:57.096602 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '8bf2cb0f-9b2a-4410-9977-d3f61b08bf38', 'neutron:router_id': '217e011a-b084-4e61-a5f2-74fae1ee978c'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:32:57.096941 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:32:59.323747 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=56b584c3-f1b1-4803-8b83-f122d0a0cf0a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c0ddd13a-3666-4b4f-9d21-ab036ecf7af2', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-202f203f-c921-45a0-b94f-5f8412303436', 'neutron:subnet_ids': '7b783bd0-f989-41c9-94cf-3a532a728aeb'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'dhcpv6_stateful', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:79:26:3a', name='lrp-e87061a1-adbc-4d63-9de6-d634ee3b0e4e', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:00.300643 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=56b584c3-f1b1-4803-8b83-f122d0a0cf0a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c0ddd13a-3666-4b4f-9d21-ab036ecf7af2', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-202f203f-c921-45a0-b94f-5f8412303436', 'neutron:subnet_ids': '7b783bd0-f989-41c9-94cf-3a532a728aeb'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'dhcpv6_stateful', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:79:26:3a', name='lrp-e87061a1-adbc-4d63-9de6-d634ee3b0e4e', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:01.859648 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23713257-736e-49c9-9f32-3e97b8164096, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c0ddd13a-3666-4b4f-9d21-ab036ecf7af2', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d6334a20-88dd-46dd-bb7e-0614920826fd', 'neutron:subnet_ids': 'c83081cb-157f-4f68-8e94-57e1b5c6992d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:41:cf:67', name='lrp-4c656037-29ca-4d8e-925d-32f24d6596ad', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:02.500358 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23713257-736e-49c9-9f32-3e97b8164096, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c0ddd13a-3666-4b4f-9d21-ab036ecf7af2', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d6334a20-88dd-46dd-bb7e-0614920826fd', 'neutron:subnet_ids': 'c83081cb-157f-4f68-8e94-57e1b5c6992d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:41:cf:67', name='lrp-4c656037-29ca-4d8e-925d-32f24d6596ad', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:07.088904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:33:18.023201 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5f3f3049-28d9-41fa-8556-9895052d30a5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-76022d51-79c9-4e9c-a137-212ad56497fb', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-a92b61f5-d335-4f50-9330-d10fb7279581', 'neutron:subnet_ids': '13915700-4206-45d9-bdfd-69b8458b1b6c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:13:99:51', name='lrp-58657941-14eb-46c6-b851-2f66d3185f21', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:18.024640 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-76022d51-79c9-4e9c-a137-212ad56497fb, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a92b61f5-d335-4f50-9330-d10fb7279581 Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:33:18.546188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:33:18.547647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:33:18.547647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a92b61f5-d335-4f50-9330-d10fb7279581 Nov 24 14:33:18.547647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:33:22.032383 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8841f0bd-0bc2-4991-97ca-155570e9a2f4, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4c4f1974-7427-4ef1-a963-9ebc7e6277fb', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[02672775-a578-4a76-87f1-e7bb5ede7b7b], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:80:d8:29', name='lrp-8b40e932-eff1-44d2-b945-ec7cb08abbee', networks=['172.24.5.50/24', '2001:db8::57/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:24.942744 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ef2c8375-8668-4824-9fb3-e2f2b00b5807, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4c4f1974-7427-4ef1-a963-9ebc7e6277fb', 'neutron:subnet_ids': '87705562-a0fa-4ec5-bf1e-bd51b5cbc160'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:20:41:82', name='lrp-ca719bc7-a2c1-492e-9a95-3cbf58485ac0', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:24.985154 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:33:24.987064 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '2ab226ff-6fb3-484a-9283-babbf8012f0d', 'neutron:router_id': '4c4f1974-7427-4ef1-a963-9ebc7e6277fb'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:33:24.987064 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:33:34.979305 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:33:47.282609 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c4ef9cb8-3333-4e58-b48f-3e98186c9b7c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-d5c3757b-a86a-45e3-952d-baf422600bc6', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-068d45b2-1cd0-4a43-b044-1735541b8042', 'neutron:subnet_ids': 'd6795a68-97bc-46f6-a407-50d83b7ddd78'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7f:5d:73', name='lrp-e3f9e011-f3fd-4b5e-9f10-86e5f5f08a46', networks=['2001:db8::28a/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:47.827625 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c4ef9cb8-3333-4e58-b48f-3e98186c9b7c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-d5c3757b-a86a-45e3-952d-baf422600bc6', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-068d45b2-1cd0-4a43-b044-1735541b8042', 'neutron:subnet_ids': 'd6795a68-97bc-46f6-a407-50d83b7ddd78'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7f:5d:73', name='lrp-e3f9e011-f3fd-4b5e-9f10-86e5f5f08a46', networks=['2001:db8::28a/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:58.346920 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=547eb43e-463b-4132-9140-301032b98b8b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c4a8483f-dd6c-4ea3-98f2-355a0f85d294', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d08337e-43f6-4644-8e9f-90a00c6ea1bb', 'neutron:subnet_ids': '3d25f9ee-ea86-471a-8fb0-f119d43ccf91'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ba:87:68', name='lrp-f8bcd557-d8b1-4ba2-8587-b3befac25a39', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:33:59.780677 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7acb2d94-0db9-442b-a949-7386115bc035, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1d069ba7-2245-4931-990e-9d94d5ca4768', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d08337e-43f6-4644-8e9f-90a00c6ea1bb', 'neutron:subnet_ids': '813bc254-c165-4c95-bacf-1651397e2f40'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b9:2b:3d', name='lrp-701f1ae3-fab7-4b6b-aa39-8dadc20a7556', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:07.078311 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7acb2d94-0db9-442b-a949-7386115bc035, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1d069ba7-2245-4931-990e-9d94d5ca4768', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d08337e-43f6-4644-8e9f-90a00c6ea1bb', 'neutron:subnet_ids': '813bc254-c165-4c95-bacf-1651397e2f40'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b9:2b:3d', name='lrp-701f1ae3-fab7-4b6b-aa39-8dadc20a7556', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:07.547060 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=547eb43e-463b-4132-9140-301032b98b8b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c4a8483f-dd6c-4ea3-98f2-355a0f85d294', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-8d08337e-43f6-4644-8e9f-90a00c6ea1bb', 'neutron:subnet_ids': '3d25f9ee-ea86-471a-8fb0-f119d43ccf91'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ba:87:68', name='lrp-f8bcd557-d8b1-4ba2-8587-b3befac25a39', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:11.485345 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=376c1fe7-74a8-4238-bba5-1a6799a633de, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4b6ea198-758d-420b-8a0f-8da41118af94', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-6375dd73-3071-45e8-b52b-a4b7d0cfcb58', 'neutron:subnet_ids': 'fca9bbc8-a316-488a-9ceb-823d34cdbe6f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:74:6e:d9', name='lrp-c640556e-2e6e-4beb-abd2-d3ba5a1a5929', networks=['10.1.0.4/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:12.056627 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=376c1fe7-74a8-4238-bba5-1a6799a633de, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4b6ea198-758d-420b-8a0f-8da41118af94', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-6375dd73-3071-45e8-b52b-a4b7d0cfcb58', 'neutron:subnet_ids': 'fca9bbc8-a316-488a-9ceb-823d34cdbe6f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:74:6e:d9', name='lrp-c640556e-2e6e-4beb-abd2-d3ba5a1a5929', networks=['10.1.0.4/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:14.975744 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=70049578-7e82-4ffb-a384-fcf6a2bb83d6, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-200000aa-dbbe-4626-ab22-2b48830da441', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b2512076-8b94-45ef-b410-79fb3614ae97', 'neutron:subnet_ids': 'e1a99920-481f-45ae-9f81-51041563c763'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:47:71:38', name='lrp-a605b49f-3135-46c9-91a6-185d4f622d33', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:17.836765 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=70049578-7e82-4ffb-a384-fcf6a2bb83d6, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-200000aa-dbbe-4626-ab22-2b48830da441', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b2512076-8b94-45ef-b410-79fb3614ae97', 'neutron:subnet_ids': 'e1a99920-481f-45ae-9f81-51041563c763'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:47:71:38', name='lrp-a605b49f-3135-46c9-91a6-185d4f622d33', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:19.479105 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f7083f3d-fc80-4c09-88cc-a86dd27ee07d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a6ddd438-4dfe-4ef8-8ea4-e975761001f5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[ef2df0e2-d52e-42c8-bb47-73c9d065663a], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:26:02:26', name='lrp-605ccae0-5753-4843-8784-a07c6a71a391', networks=['172.24.5.49/24', '2001:db8::8b/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a6ddd438-4dfe-4ef8-8ea4-e975761001f5 Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:20.708098 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:34:20.709105 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:34:20.709105 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a6ddd438-4dfe-4ef8-8ea4-e975761001f5 Nov 24 14:34:20.709105 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:34:22.642595 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d3688cee-0cf0-43ed-8a80-005f0d08dc98, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-458e54d4-7726-4c65-9a1d-7f30f491d73c', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-bc592539-191e-4a10-aa96-2cb61a503d96', 'neutron:subnet_ids': '7910950d-b3b5-41df-ae20-d6e32baa5f9e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:86:5b:e7', name='lrp-5956f0d9-0d6d-47d5-b8c9-f785b5aac48e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:24.671995 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d3688cee-0cf0-43ed-8a80-005f0d08dc98, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-458e54d4-7726-4c65-9a1d-7f30f491d73c', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-bc592539-191e-4a10-aa96-2cb61a503d96', 'neutron:subnet_ids': '7910950d-b3b5-41df-ae20-d6e32baa5f9e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:86:5b:e7', name='lrp-5956f0d9-0d6d-47d5-b8c9-f785b5aac48e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:27.414294 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=75b8b9c9-37e1-4c2c-8a00-4657826a1acd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-aa23004b-106d-4842-b2c0-0a0cb91b92d0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': 'f7038dda-46eb-48fe-ab3e-bc1c037a605f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:af:62:8f', name='lrp-8b2f1916-18d3-499e-9c08-9758e0a4e41b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:29.754389 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ace30899-74a6-4230-a11d-79c62847cc7f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-75b722c7-c2d0-49da-a338-44d98c5207a5', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '286ad8ae-ae31-461e-bde8-060fd2a8c58a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0d:c1:a9', name='lrp-6250d408-1dfe-4eb9-98a2-a32a6cdb4ae8', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:32.186649 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=163e0e97-fd87-4649-85c8-fb394c62ce6b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c9d4a0c4-cc84-4215-af49-604f13799cac', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '457682f6-5f55-469a-9f58-9143e9da41fc'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:26:5c:f1', name='lrp-99e54cf6-afcd-4f04-a5c2-9868fb050d78', networks=['10.1.32.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:34.201595 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=abc860dd-d238-4b0e-993a-197f7510ff45, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-df80436b-316f-4245-9eeb-55b3d9e1d90b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '3a5149af-bf8d-4c3b-badf-769187b0b2df'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fc:66:b6', name='lrp-9ee83873-0c29-4fd2-91d1-b1677c8bc515', networks=['10.1.48.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:38.714342 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=abc860dd-d238-4b0e-993a-197f7510ff45, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-df80436b-316f-4245-9eeb-55b3d9e1d90b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '3a5149af-bf8d-4c3b-badf-769187b0b2df'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fc:66:b6', name='lrp-9ee83873-0c29-4fd2-91d1-b1677c8bc515', networks=['10.1.48.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:39.797845 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=163e0e97-fd87-4649-85c8-fb394c62ce6b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c9d4a0c4-cc84-4215-af49-604f13799cac', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '457682f6-5f55-469a-9f58-9143e9da41fc'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:26:5c:f1', name='lrp-99e54cf6-afcd-4f04-a5c2-9868fb050d78', networks=['10.1.32.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:41.067963 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ace30899-74a6-4230-a11d-79c62847cc7f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-75b722c7-c2d0-49da-a338-44d98c5207a5', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': '286ad8ae-ae31-461e-bde8-060fd2a8c58a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0d:c1:a9', name='lrp-6250d408-1dfe-4eb9-98a2-a32a6cdb4ae8', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:42.744853 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=75b8b9c9-37e1-4c2c-8a00-4657826a1acd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-aa23004b-106d-4842-b2c0-0a0cb91b92d0', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ec084e6e-518f-4549-839c-255e58a85cdc', 'neutron:subnet_ids': 'f7038dda-46eb-48fe-ab3e-bc1c037a605f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:af:62:8f', name='lrp-8b2f1916-18d3-499e-9c08-9758e0a4e41b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:57.323481 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ef2c8375-8668-4824-9fb3-e2f2b00b5807, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-4c4f1974-7427-4ef1-a963-9ebc7e6277fb', 'neutron:subnet_ids': '87705562-a0fa-4ec5-bf1e-bd51b5cbc160'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:20:41:82', name='lrp-ca719bc7-a2c1-492e-9a95-3cbf58485ac0', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:34:57.324211 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-2ab226ff-6fb3-484a-9283-babbf8012f0d, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4c4f1974-7427-4ef1-a963-9ebc7e6277fb Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:34:57.990983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:34:57.991686 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:34:57.991686 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4c4f1974-7427-4ef1-a963-9ebc7e6277fb Nov 24 14:34:57.991686 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:35:35.550539 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=33e49fbb-17c0-4cb8-8b0e-c819a8695797, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-217e011a-b084-4e61-a5f2-74fae1ee978c', 'neutron:subnet_ids': '66a97765-51f2-462b-b226-70bbb11d7223'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1b:01:80', name='lrp-6054f921-9e0a-42ee-a4ff-59064b28478c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:35:35.552012 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-8bf2cb0f-9b2a-4410-9977-d3f61b08bf38, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-217e011a-b084-4e61-a5f2-74fae1ee978c Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:35:36.091676 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:35:36.092198 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:35:36.092198 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-217e011a-b084-4e61-a5f2-74fae1ee978c Nov 24 14:35:36.092198 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:35:45.660168 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=93aad806-e978-4ef7-89c4-3961b2a54887, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e0f49e46-d6a1-43d1-870c-a1d0784455be', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[e3285e99-8e9b-47d8-b256-2436695280b9], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1e:19:86', name='lrp-328d1697-7dbc-4de6-8608-4a2479cba7fd', networks=['172.24.5.160/24', '2001:db8::29d/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:35:47.348431 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=15572ccf-a4da-482a-a340-d769ac635db9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-598330ad-308d-4def-9896-dd93a7c42e1f', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e0f49e46-d6a1-43d1-870c-a1d0784455be', 'neutron:subnet_ids': '81645c14-bb8a-40fe-9121-d9f6ded15665'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ef:22:e0', name='lrp-30d399c6-a875-47d0-a423-a1c4c36d7b3e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:35:47.373526 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-598330ad-308d-4def-9896-dd93a7c42e1f synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:35:47.374379 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-598330ad-308d-4def-9896-dd93a7c42e1f, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '598330ad-308d-4def-9896-dd93a7c42e1f', 'neutron:router_id': 'e0f49e46-d6a1-43d1-870c-a1d0784455be'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:35:47.374958 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-598330ad-308d-4def-9896-dd93a7c42e1f, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:35:57.372740 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:36:11.370431 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:36:11.381481 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:36:11.381481 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Number of inconsistencies found at delete: router_ports=6 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:36:11.381674 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource 31488eb8-218d-4006-9635-87c4e1fac35f (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.382035 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(31488eb8-218d-4006-9635-87c4e1fac35f) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.388113 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource 46a9417e-3853-47e4-9f06-b2d857d40ae3 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.388608 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(46a9417e-3853-47e4-9f06-b2d857d40ae3) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.397151 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource 605ccae0-5753-4843-8784-a07c6a71a391 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.397549 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(605ccae0-5753-4843-8784-a07c6a71a391) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.406355 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource 8b40e932-eff1-44d2-b945-ec7cb08abbee (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.406681 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(8b40e932-eff1-44d2-b945-ec7cb08abbee) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.410990 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource a1a10d07-ad1f-4164-a4f7-1ef5706a5e54 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.411285 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(a1a10d07-ad1f-4164-a4f7-1ef5706a5e54) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.415289 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Fixing resource d9dcb176-8192-475f-b7e9-8bd1697420b4 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:36:11.415589 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] delete_revision(d9dcb176-8192-475f-b7e9-8bd1697420b4) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:36:11.420014 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-508ed158-5caf-4942-bdf0-f38131b3049e None None] Maintenance task: Synchronization completed (took 0.04 seconds) Nov 24 14:36:20.590336 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b6e13890-fddd-4949-aca3-64dbb6f268a0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-34786f11-6e44-463d-a218-2d3dbec2755b', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[a428000d-c94d-4a7c-8967-7e80e7422e14], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:5a:0c:ac', name='lrp-211e2c11-3dd1-4248-8e18-b610eeac2f2e', networks=['172.24.5.11/24', '2001:db8::48/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:21.417749 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=8,neutron:DELETE=6 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:36:22.575918 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1953f0b1-7e58-4804-a0b2-99aec1f0b4b2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-454ac49e-dbce-4508-9560-f234d8e45128', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-34786f11-6e44-463d-a218-2d3dbec2755b', 'neutron:subnet_ids': '283ccac2-3937-4e0f-bc1a-b50d1915c931'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:56:8d:90', name='lrp-c2ac9e49-c282-4a7a-8863-ff3c5a1ce7db', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:22.603599 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-454ac49e-dbce-4508-9560-f234d8e45128 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:36:22.603599 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-454ac49e-dbce-4508-9560-f234d8e45128, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '454ac49e-dbce-4508-9560-f234d8e45128', 'neutron:router_id': '34786f11-6e44-463d-a218-2d3dbec2755b'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:22.603599 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-454ac49e-dbce-4508-9560-f234d8e45128, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:32.601426 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:36:34.829228 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=98e3186c-a6b3-486a-a553-4fec12b66f77, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fd73e458-b131-4591-a71f-5be4735a5921', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[fdc8c206-9fc7-4779-8f57-466abb593496], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:04:59:fd', name='lrp-bf05311e-a1d5-4ae5-b0a3-3cd08c3ee703', networks=['172.24.5.91/24', '2001:db8::2f4/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:36.484513 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=aacae465-eb25-436e-94f7-efa4d6e1ef0a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-078edb30-a619-486e-89a0-c173725eb32e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fd73e458-b131-4591-a71f-5be4735a5921', 'neutron:subnet_ids': '5b60ce37-7167-4501-9d57-02f017a0fee0'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:98:2d:b5', name='lrp-af60174b-2eef-48e3-915f-323cc9e94aae', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:36.503468 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-078edb30-a619-486e-89a0-c173725eb32e synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:36:36.504079 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-078edb30-a619-486e-89a0-c173725eb32e, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '078edb30-a619-486e-89a0-c173725eb32e', 'neutron:router_id': 'fd73e458-b131-4591-a71f-5be4735a5921'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:36.504549 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-078edb30-a619-486e-89a0-c173725eb32e, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:39.028779 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=aacae465-eb25-436e-94f7-efa4d6e1ef0a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-078edb30-a619-486e-89a0-c173725eb32e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fd73e458-b131-4591-a71f-5be4735a5921', 'neutron:subnet_ids': '5b60ce37-7167-4501-9d57-02f017a0fee0'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:98:2d:b5', name='lrp-af60174b-2eef-48e3-915f-323cc9e94aae', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:39.030123 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-078edb30-a619-486e-89a0-c173725eb32e, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fd73e458-b131-4591-a71f-5be4735a5921 Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:39.686353 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:36:39.686994 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:36:39.686994 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fd73e458-b131-4591-a71f-5be4735a5921 Nov 24 14:36:39.686994 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:36:41.678809 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1953f0b1-7e58-4804-a0b2-99aec1f0b4b2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-454ac49e-dbce-4508-9560-f234d8e45128', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-34786f11-6e44-463d-a218-2d3dbec2755b', 'neutron:subnet_ids': '283ccac2-3937-4e0f-bc1a-b50d1915c931'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:56:8d:90', name='lrp-c2ac9e49-c282-4a7a-8863-ff3c5a1ce7db', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:36:41.679470 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-454ac49e-dbce-4508-9560-f234d8e45128, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-34786f11-6e44-463d-a218-2d3dbec2755b Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:36:42.294613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:36:42.294909 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:36:42.294909 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-34786f11-6e44-463d-a218-2d3dbec2755b Nov 24 14:36:42.294909 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:36:46.502900 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:37:00.582333 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=15572ccf-a4da-482a-a340-d769ac635db9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-598330ad-308d-4def-9896-dd93a7c42e1f', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-e0f49e46-d6a1-43d1-870c-a1d0784455be', 'neutron:subnet_ids': '81645c14-bb8a-40fe-9121-d9f6ded15665'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ef:22:e0', name='lrp-30d399c6-a875-47d0-a423-a1c4c36d7b3e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:00.582333 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-598330ad-308d-4def-9896-dd93a7c42e1f, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e0f49e46-d6a1-43d1-870c-a1d0784455be Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:01.683591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:37:01.684647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:37:01.684647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e0f49e46-d6a1-43d1-870c-a1d0784455be Nov 24 14:37:01.684647 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:37:05.759174 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=aebfb593-1be4-418d-a160-07e11f5bb60a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[f11ddf6d-06f6-4212-acc1-0df919391d8c], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e2:68:74', name='lrp-a9edf3a6-526a-4129-8037-5d926cd0b218', networks=['172.24.5.9/24', '2001:db8::273/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:07.319782 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5766c6e9-68a3-440b-a62e-69e145b7364a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399', 'neutron:subnet_ids': 'f31b4391-1835-48b1-9e6c-feb32f44c77c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f2:7c:14', name='lrp-981e8163-c1bd-4da1-8e50-a1141cc1c4bb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:07.385141 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:37:07.385672 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '3493f966-aa58-4f6f-9e2c-23b8f8113449', 'neutron:router_id': '40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:37:07.385938 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:37:17.380314 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:37:32.989763 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23b6da38-8908-44c0-ac45-fa347e44100a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-23a7c3fb-6962-4a19-8b3e-d01a6c2814d6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e47d6db3-2796-49d9-9a94-21304a3dc7d7', 'neutron:subnet_ids': 'ddb02ede-d28e-4d10-9b28-730423de8a35'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e3:cd:e8', name='lrp-9918838b-782d-4b46-9294-d1096c1b2a43', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:34.157745 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dc95d613-ed6b-4f9e-be3e-3d6f3335ae1f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-36f79284-4dc6-4a18-970c-10992c3cd817', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e47d6db3-2796-49d9-9a94-21304a3dc7d7', 'neutron:subnet_ids': 'a2524f8d-d214-4f04-a459-e8ffe11e7e1b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:4a:31:6b', name='lrp-28c7837a-b4c7-4195-a9a0-e16902adaaa8', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:34.745377 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dc95d613-ed6b-4f9e-be3e-3d6f3335ae1f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-36f79284-4dc6-4a18-970c-10992c3cd817', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e47d6db3-2796-49d9-9a94-21304a3dc7d7', 'neutron:subnet_ids': 'a2524f8d-d214-4f04-a459-e8ffe11e7e1b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:4a:31:6b', name='lrp-28c7837a-b4c7-4195-a9a0-e16902adaaa8', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:35.223455 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23b6da38-8908-44c0-ac45-fa347e44100a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-23a7c3fb-6962-4a19-8b3e-d01a6c2814d6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e47d6db3-2796-49d9-9a94-21304a3dc7d7', 'neutron:subnet_ids': 'ddb02ede-d28e-4d10-9b28-730423de8a35'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e3:cd:e8', name='lrp-9918838b-782d-4b46-9294-d1096c1b2a43', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:38.709136 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f0de0b17-3ae6-49a1-949e-d935388dd607, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5c643c31-b4db-40d1-8d5c-f1d536222a55', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-c25f8c66-0106-43dd-888f-406dea52f43d', 'neutron:subnet_ids': '59411cc4-5c43-49bb-bb59-cd820ed50844'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:87:2e:d3', name='lrp-cf4b384f-a736-486b-9285-ef34279ea084', networks=['2001:db8::35b/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:39.300210 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f0de0b17-3ae6-49a1-949e-d935388dd607, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5c643c31-b4db-40d1-8d5c-f1d536222a55', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-c25f8c66-0106-43dd-888f-406dea52f43d', 'neutron:subnet_ids': '59411cc4-5c43-49bb-bb59-cd820ed50844'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:87:2e:d3', name='lrp-cf4b384f-a736-486b-9285-ef34279ea084', networks=['2001:db8::35b/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:41.973885 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f60acd20-4b05-4a26-9057-fff198caf2fd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-e0e79fd5-d0d1-454e-a064-f86506104f55', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-c28783ea-d21c-44b9-aafa-2b8c48cdb76f', 'neutron:subnet_ids': '41eed301-5b1a-4539-8beb-41e4b1c1dbd3'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:c9:13', name='lrp-a76893c3-36e5-4185-9721-3a4edf50524a', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:44.872153 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f60acd20-4b05-4a26-9057-fff198caf2fd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-e0e79fd5-d0d1-454e-a064-f86506104f55', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-c28783ea-d21c-44b9-aafa-2b8c48cdb76f', 'neutron:subnet_ids': '41eed301-5b1a-4539-8beb-41e4b1c1dbd3'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:c9:13', name='lrp-a76893c3-36e5-4185-9721-3a4edf50524a', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:46.486754 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=24ef5279-76f0-482a-9d87-dcc2e77a8638, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4348e8b4-69ad-4603-8bb7-973df3ae36cc', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[00ecccce-e651-45dc-9dcb-fd31b09a47c8], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b1:98:9f', name='lrp-b18446fd-0c34-4909-84fe-0def37b80d0f', networks=['172.24.5.128/24', '2001:db8::ca/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4348e8b4-69ad-4603-8bb7-973df3ae36cc Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:37:47.799018 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:37:47.800525 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:37:47.800525 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4348e8b4-69ad-4603-8bb7-973df3ae36cc Nov 24 14:37:47.800525 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:37:49.535504 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3ff5ff6b-4d2c-4fde-acc6-b8326d87ca08, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5795192d-70e2-4056-896e-5807d08c2f68', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f62f6d95-0277-4c82-a132-6cf87eb07d29', 'neutron:subnet_ids': '07254bb2-a6c9-4111-b46c-c430df58a140'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:dd:f7:7b', name='lrp-a43e01f5-d1b5-4cfa-ba7b-b249edea12ed', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:50.591951 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3ff5ff6b-4d2c-4fde-acc6-b8326d87ca08, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5795192d-70e2-4056-896e-5807d08c2f68', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f62f6d95-0277-4c82-a132-6cf87eb07d29', 'neutron:subnet_ids': '07254bb2-a6c9-4111-b46c-c430df58a140'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:dd:f7:7b', name='lrp-a43e01f5-d1b5-4cfa-ba7b-b249edea12ed', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:53.548051 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bcde2aa8-39ee-477a-8f99-123af6dd964b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0412a915-f161-4c2a-b757-23afdf33f326', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '63446da6-cd1e-4915-8041-54211866e3bb'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7c:54:f8', name='lrp-a0d2ff61-462a-4799-b9b9-86a2e3af6676', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:55.789628 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bdcf71e6-913e-4df2-b0e9-35ea4620c6bd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-af5b88ea-f6d7-4174-993e-e9506fe554ff', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '8e03d907-1fe8-422c-94fc-c06a27ca5dd6'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3d:69:7c', name='lrp-3ee58cf6-f719-4356-b72f-33c64892c223', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:57.570529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=249c4764-462a-411d-85c4-b39a27b8d94c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6ece7305-87a2-4792-a2aa-5aa8711d7de6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '24102a93-a070-4dfe-a44f-9fbb16e66c82'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:42:6d:c6', name='lrp-5bb2d9dc-43c0-40d2-8b28-b93bd5e4bb8d', networks=['2001:db8:2::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:37:59.800226 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=94ae2214-d572-48b2-9a43-1418a3c299f1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b371dd1f-6822-4a69-a919-8846c800aa89', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '5358fdc6-a7c7-4876-84ac-5d24906cc7e6'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:8e:26:f7', name='lrp-1dff582a-9572-48b5-96c6-4efd3a31f9ae', networks=['2001:db8:3::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:02.431900 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=94ae2214-d572-48b2-9a43-1418a3c299f1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b371dd1f-6822-4a69-a919-8846c800aa89', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '5358fdc6-a7c7-4876-84ac-5d24906cc7e6'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:8e:26:f7', name='lrp-1dff582a-9572-48b5-96c6-4efd3a31f9ae', networks=['2001:db8:3::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:03.348409 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=249c4764-462a-411d-85c4-b39a27b8d94c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6ece7305-87a2-4792-a2aa-5aa8711d7de6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '24102a93-a070-4dfe-a44f-9fbb16e66c82'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:42:6d:c6', name='lrp-5bb2d9dc-43c0-40d2-8b28-b93bd5e4bb8d', networks=['2001:db8:2::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:04.416330 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bdcf71e6-913e-4df2-b0e9-35ea4620c6bd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-af5b88ea-f6d7-4174-993e-e9506fe554ff', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '8e03d907-1fe8-422c-94fc-c06a27ca5dd6'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3d:69:7c', name='lrp-3ee58cf6-f719-4356-b72f-33c64892c223', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:05.631107 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bcde2aa8-39ee-477a-8f99-123af6dd964b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0412a915-f161-4c2a-b757-23afdf33f326', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-e6656614-fab0-4d69-b340-6b5d0173fc98', 'neutron:subnet_ids': '63446da6-cd1e-4915-8041-54211866e3bb'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7c:54:f8', name='lrp-a0d2ff61-462a-4799-b9b9-86a2e3af6676', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:39.954447 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=96323945-c256-4e7b-95cf-2c219d8df20b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-c1dd3cbe-ad22-442f-a84b-7dfb84743bb1', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[bf24638b-e8fa-4416-ae3a-7456bf96fe64], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:8c:42:bd', name='lrp-06bbf6ab-2fe0-4be9-b1f7-bd0e410f3714', networks=['172.24.5.84/24', '2001:db8::b7/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:41.187865 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7fd01a75-13b5-437d-9ccb-be54dd73b16f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-c1dd3cbe-ad22-442f-a84b-7dfb84743bb1', 'neutron:subnet_ids': 'e9178842-3fd7-4dab-a5c3-7366ff4558af'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:21:ca:93', name='lrp-de2cdb73-38e9-4f2f-9605-ed123085d544', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:41.222793 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:38:41.223628 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '7fe9b8bf-a8bf-406d-87e0-09d02707a7c0', 'neutron:router_id': 'c1dd3cbe-ad22-442f-a84b-7dfb84743bb1'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:38:41.224094 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:38:44.590136 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6eccac63-b99f-4365-b9d6-193a06e870b1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-9b7e99c0-1b68-4606-aada-254e2b81c7a3', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[7bc905da-a519-4eda-b737-965c24e64d03], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:21:17:61', name='lrp-67a2ced1-5178-46ae-99df-8e1a1d525cad', networks=['172.24.5.20/24', '2001:db8::3ae/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:45.970544 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=81f2ca6b-1929-49e5-a88e-6209f394456c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-55934a28-e2c4-4323-85c9-0f697a18616a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-9b7e99c0-1b68-4606-aada-254e2b81c7a3', 'neutron:subnet_ids': 'd0d277d1-9557-40c8-88ed-d8b027729926'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:10:4a:62', name='lrp-de644c23-ab53-4ff3-a6d5-d03329560169', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:38:46.017984 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-55934a28-e2c4-4323-85c9-0f697a18616a synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:38:46.018817 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-55934a28-e2c4-4323-85c9-0f697a18616a, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '55934a28-e2c4-4323-85c9-0f697a18616a', 'neutron:router_id': '9b7e99c0-1b68-4606-aada-254e2b81c7a3'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:38:46.019662 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-55934a28-e2c4-4323-85c9-0f697a18616a, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:38:56.016142 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:39:56.586082 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7fd01a75-13b5-437d-9ccb-be54dd73b16f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-c1dd3cbe-ad22-442f-a84b-7dfb84743bb1', 'neutron:subnet_ids': 'e9178842-3fd7-4dab-a5c3-7366ff4558af'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:21:ca:93', name='lrp-de2cdb73-38e9-4f2f-9605-ed123085d544', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:39:56.587289 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-7fe9b8bf-a8bf-406d-87e0-09d02707a7c0, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-c1dd3cbe-ad22-442f-a84b-7dfb84743bb1 Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:57.168331 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:39:57.168621 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:39:57.168621 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-c1dd3cbe-ad22-442f-a84b-7dfb84743bb1 Nov 24 14:39:57.168621 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:39:58.406724 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=81f2ca6b-1929-49e5-a88e-6209f394456c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-55934a28-e2c4-4323-85c9-0f697a18616a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-9b7e99c0-1b68-4606-aada-254e2b81c7a3', 'neutron:subnet_ids': 'd0d277d1-9557-40c8-88ed-d8b027729926'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:10:4a:62', name='lrp-de644c23-ab53-4ff3-a6d5-d03329560169', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:39:58.407722 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-55934a28-e2c4-4323-85c9-0f697a18616a, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-9b7e99c0-1b68-4606-aada-254e2b81c7a3 Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:39:59.285313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:39:59.285598 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:39:59.285598 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-9b7e99c0-1b68-4606-aada-254e2b81c7a3 Nov 24 14:39:59.285598 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:41:11.372361 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:41:11.384175 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:41:11.384406 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, routers=1, router_ports=1 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:41:11.384649 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Number of inconsistencies found at delete: router_ports=6 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:41:11.384848 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 3493f966-aa58-4f6f-9e2c-23b8f8113449 (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:41:11.443830 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449, resource={'id': '3493f966-aa58-4f6f-9e2c-23b8f8113449', 'name': 'tempest-VolumesBackupsTest-1431410385-network', 'tenant_id': 'c642367dafaa45dd89634e7ec9822ef2', 'project_id': 'c642367dafaa45dd89634e7ec9822ef2', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f31b4391-1835-48b1-9e6c-feb32f44c77c'], 'standard_attr_id': 2034, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:37:03Z', 'updated_at': '2025-11-24T19:37:04Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 51630}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.444233 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449, col_values=(('external_ids', {'neutron:network_name': 'tempest-VolumesBackupsTest-1431410385-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.444757 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-466f5520-dbaf-498b-b2e8-6dc9e6f0b1ee, external_ids_update=None, columns={'tag': 51630}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.501667 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Successfully bumped revision number for resource 3493f966-aa58-4f6f-9e2c-23b8f8113449 (type: networks) to 2 Nov 24 14:41:11.501886 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399 (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:41:11.735583 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399, resource={'id': '40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399', 'name': 'tempest-VolumesBackupsTest-1431410385-router', 'tenant_id': 'c642367dafaa45dd89634e7ec9822ef2', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.9'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::273'}], 'enable_snat': True}, 'gw_port_id': 'a9edf3a6-526a-4129-8037-5d926cd0b218', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.9', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::273', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:37:04Z', 'updated_at': '2025-11-24T19:37:06Z', 'revision_number': 3, 'project_id': 'c642367dafaa45dd89634e7ec9822ef2'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.735961 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399, columns={'external_ids': {'neutron:router_name': 'tempest-VolumesBackupsTest-1431410385-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.736283 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "a9edf3a6-526a-4129-8037-5d926cd0b218"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.736587 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "a9edf3a6-526a-4129-8037-5d926cd0b218"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.767131 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Successfully bumped revision number for resource 40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399 (type: routers) to 3 Nov 24 14:41:11.767229 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource a9edf3a6-526a-4129-8037-5d926cd0b218 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:41:11.834485 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-a9edf3a6-526a-4129-8037-5d926cd0b218, resource={'id': 'a9edf3a6-526a-4129-8037-5d926cd0b218', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:68:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2040, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.9'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::273'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:37:05Z', 'updated_at': '2025-11-24T19:37:07Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.834933 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-a9edf3a6-526a-4129-8037-5d926cd0b218, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::273/64', '172.24.5.9/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.835383 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=a9edf3a6-526a-4129-8037-5d926cd0b218, lrouter_port=lrp-a9edf3a6-526a-4129-8037-5d926cd0b218, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:41:11.855438 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Successfully bumped revision number for resource a9edf3a6-526a-4129-8037-5d926cd0b218 (type: router_ports) to 5 Nov 24 14:41:11.855528 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 06bbf6ab-2fe0-4be9-b1f7-bd0e410f3714 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.855730 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(06bbf6ab-2fe0-4be9-b1f7-bd0e410f3714) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.861895 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 211e2c11-3dd1-4248-8e18-b610eeac2f2e (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.862051 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(211e2c11-3dd1-4248-8e18-b610eeac2f2e) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.866792 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 328d1697-7dbc-4de6-8608-4a2479cba7fd (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.866935 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(328d1697-7dbc-4de6-8608-4a2479cba7fd) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.870131 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource 67a2ced1-5178-46ae-99df-8e1a1d525cad (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.870281 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(67a2ced1-5178-46ae-99df-8e1a1d525cad) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.874652 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource b18446fd-0c34-4909-84fe-0def37b80d0f (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.874816 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(b18446fd-0c34-4909-84fe-0def37b80d0f) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.878063 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Fixing resource bf05311e-a1d5-4ae5-b0a3-3cd08c3ee703 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:41:11.878260 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] delete_revision(bf05311e-a1d5-4ae5-b0a3-3cd08c3ee703) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:41:11.882001 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dfdb2d6d-e473-42b8-b9f7-7ee26efde82e None None] Maintenance task: Synchronization completed (took 0.50 seconds) Nov 24 14:41:21.880134 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=192,neutron:UPDATE=3,neutron:DELETE=6 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:42:33.833514 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5766c6e9-68a3-440b-a62e-69e145b7364a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399', 'neutron:subnet_ids': 'f31b4391-1835-48b1-9e6c-feb32f44c77c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f2:7c:14', name='lrp-981e8163-c1bd-4da1-8e50-a1141cc1c4bb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:42:33.835591 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-3493f966-aa58-4f6f-9e2c-23b8f8113449, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399 Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:42:34.346861 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:42:34.347370 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:42:34.347370 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-40c1cf8c-ba1b-4c9e-bf63-1eb3839cf399 Nov 24 14:42:34.347370 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:42:51.657166 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=0528110b-18a0-4d8b-9de0-18167f2227ed, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d444fe0-9949-4e32-a0d2-82060e397665', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[4b14dd1b-13f1-4c5e-9d3d-b744ab60f8ac], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:da:8b:e2', name='lrp-93491d57-7489-4b18-be54-4d7ae61520d2', networks=['172.24.5.158/24', '2001:db8::2ad/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:42:53.170340 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bf94f109-82a4-4abb-afc0-c6667f61fda8, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d444fe0-9949-4e32-a0d2-82060e397665', 'neutron:subnet_ids': 'a724bdcc-0197-43a2-9abb-5b27fed3c306'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:f9:c3', name='lrp-27d8badb-5820-402d-870b-e2773a6a5db2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:42:53.197626 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:42:53.197900 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '1944accc-9f33-40dc-8ec2-18dd829fbee9', 'neutron:router_id': '8d444fe0-9949-4e32-a0d2-82060e397665'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:42:53.198983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:43:03.196222 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:46:11.373900 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:46:11.382466 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:46:11.382716 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, routers=1, router_ports=1 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:46:11.382896 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Number of inconsistencies found at delete: router_ports=1 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:46:11.383071 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Fixing resource 1944accc-9f33-40dc-8ec2-18dd829fbee9 (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:46:11.442002 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9, resource={'id': '1944accc-9f33-40dc-8ec2-18dd829fbee9', 'name': 'tempest-VolumesSnapshotTestJSON-1620315794-network', 'tenant_id': 'f851d93dc40a47668f073fe029189315', 'project_id': 'f851d93dc40a47668f073fe029189315', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a724bdcc-0197-43a2-9abb-5b27fed3c306'], 'standard_attr_id': 2435, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:42:49Z', 'updated_at': '2025-11-24T19:42:50Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7065}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.442425 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9, col_values=(('external_ids', {'neutron:network_name': 'tempest-VolumesSnapshotTestJSON-1620315794-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.443107 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-585086f1-0b26-4792-a34c-d5dd9f5a1c90, external_ids_update=None, columns={'tag': 7065}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.472188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Successfully bumped revision number for resource 1944accc-9f33-40dc-8ec2-18dd829fbee9 (type: networks) to 2 Nov 24 14:46:11.472334 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Fixing resource 8d444fe0-9949-4e32-a0d2-82060e397665 (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:46:11.550597 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-8d444fe0-9949-4e32-a0d2-82060e397665, resource={'id': '8d444fe0-9949-4e32-a0d2-82060e397665', 'name': 'tempest-VolumesSnapshotTestJSON-1620315794-router', 'tenant_id': 'f851d93dc40a47668f073fe029189315', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.158'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::2ad'}], 'enable_snat': True}, 'gw_port_id': '93491d57-7489-4b18-be54-4d7ae61520d2', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.158', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::2ad', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:42:50Z', 'updated_at': '2025-11-24T19:42:52Z', 'revision_number': 3, 'project_id': 'f851d93dc40a47668f073fe029189315'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.550995 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-8d444fe0-9949-4e32-a0d2-82060e397665, columns={'external_ids': {'neutron:router_name': 'tempest-VolumesSnapshotTestJSON-1620315794-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.551486 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "93491d57-7489-4b18-be54-4d7ae61520d2"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.551705 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "93491d57-7489-4b18-be54-4d7ae61520d2"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.597908 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Successfully bumped revision number for resource 8d444fe0-9949-4e32-a0d2-82060e397665 (type: routers) to 3 Nov 24 14:46:11.598049 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Fixing resource 93491d57-7489-4b18-be54-4d7ae61520d2 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:46:11.672707 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-93491d57-7489-4b18-be54-4d7ae61520d2, resource={'id': '93491d57-7489-4b18-be54-4d7ae61520d2', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:8b:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d444fe0-9949-4e32-a0d2-82060e397665', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2440, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.158'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::2ad'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:42:50Z', 'updated_at': '2025-11-24T19:42:52Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.672969 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-93491d57-7489-4b18-be54-4d7ae61520d2, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-8d444fe0-9949-4e32-a0d2-82060e397665'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.158/24', '2001:db8::2ad/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.673600 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=93491d57-7489-4b18-be54-4d7ae61520d2, lrouter_port=lrp-93491d57-7489-4b18-be54-4d7ae61520d2, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:11.694195 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Successfully bumped revision number for resource 93491d57-7489-4b18-be54-4d7ae61520d2 (type: router_ports) to 5 Nov 24 14:46:11.694301 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Fixing resource a9edf3a6-526a-4129-8037-5d926cd0b218 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:46:11.694493 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] delete_revision(a9edf3a6-526a-4129-8037-5d926cd0b218) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:46:11.697976 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-be08f8bf-ac73-44ad-bf21-435e230e0b32 None None] Maintenance task: Synchronization completed (took 0.31 seconds) Nov 24 14:46:18.729532 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bf94f109-82a4-4abb-afc0-c6667f61fda8, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-8d444fe0-9949-4e32-a0d2-82060e397665', 'neutron:subnet_ids': 'a724bdcc-0197-43a2-9abb-5b27fed3c306'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:f9:c3', name='lrp-27d8badb-5820-402d-870b-e2773a6a5db2', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:46:18.730486 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-1944accc-9f33-40dc-8ec2-18dd829fbee9, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8d444fe0-9949-4e32-a0d2-82060e397665 Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:46:19.384904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:46:19.385517 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:46:19.385517 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8d444fe0-9949-4e32-a0d2-82060e397665 Nov 24 14:46:19.385517 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:46:21.696008 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=187,neutron:UPDATE=3,neutron:DELETE=1 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:46:38.891326 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=2f09e920-87ba-4dce-a4cc-4ccdbcfb6887, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-26a8685a-bdbe-44b2-bb67-9ebc90e7e511', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[e895f2be-8ad8-42af-ba01-3e5ead22dbe9], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:85:fc:73', name='lrp-e6499fc1-2b6b-4aec-9a1b-6fd09b9a1aa1', networks=['172.24.5.46/24', '2001:db8::173/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:46:41.765989 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=95f28cc8-de2f-4cb5-bc7a-58bb50dc02dc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-26a8685a-bdbe-44b2-bb67-9ebc90e7e511', 'neutron:subnet_ids': '2b29984b-537c-4d9e-87b8-d75759bb1f46'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0c:18:f3', name='lrp-0247f5b1-7bf8-4287-b2cf-4005f6b94d33', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:46:41.808308 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:46:41.809114 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '4aa49aa1-c823-4a2d-ab45-3cb852afc33f', 'neutron:router_id': '26a8685a-bdbe-44b2-bb67-9ebc90e7e511'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:41.809509 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:46:51.806140 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:47:46.150176 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=95f28cc8-de2f-4cb5-bc7a-58bb50dc02dc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-26a8685a-bdbe-44b2-bb67-9ebc90e7e511', 'neutron:subnet_ids': '2b29984b-537c-4d9e-87b8-d75759bb1f46'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0c:18:f3', name='lrp-0247f5b1-7bf8-4287-b2cf-4005f6b94d33', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:47:46.151436 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-4aa49aa1-c823-4a2d-ab45-3cb852afc33f, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-26a8685a-bdbe-44b2-bb67-9ebc90e7e511 Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:47:46.867467 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:47:46.868106 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:47:46.868106 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-26a8685a-bdbe-44b2-bb67-9ebc90e7e511 Nov 24 14:47:46.868106 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:47:48.837790 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8a42ef1b-9852-45b9-8b35-b6b91835289e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f127b91a-5a73-49ba-861a-194522d268c6', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[73dd61ce-e913-40ed-a6d8-fec215fe1478], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b2:f3:42', name='lrp-28613fdd-73fc-460b-b403-a7c16b0a238c', networks=['172.24.5.234/24', '2001:db8::12b/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:47:51.691085 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ce88204e-b029-488a-95a0-27c98aaf8078, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f127b91a-5a73-49ba-861a-194522d268c6', 'neutron:subnet_ids': '5362d5d7-614b-48fa-8457-27093e2ab941'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:9e:a9:ec', name='lrp-e2644b67-30d1-4c49-ac14-2b61cb7e5840', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:47:51.718014 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:47:51.718604 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'a2adbecf-29bf-4ea2-ab7a-69799da1c471', 'neutron:router_id': 'f127b91a-5a73-49ba-861a-194522d268c6'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:47:51.718854 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:48:01.717497 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:49:31.004995 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ce88204e-b029-488a-95a0-27c98aaf8078, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-f127b91a-5a73-49ba-861a-194522d268c6', 'neutron:subnet_ids': '5362d5d7-614b-48fa-8457-27093e2ab941'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:9e:a9:ec', name='lrp-e2644b67-30d1-4c49-ac14-2b61cb7e5840', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:49:31.008641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-a2adbecf-29bf-4ea2-ab7a-69799da1c471, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f127b91a-5a73-49ba-861a-194522d268c6 Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:49:31.719550 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:49:31.720101 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:49:31.720101 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f127b91a-5a73-49ba-861a-194522d268c6 Nov 24 14:49:31.720101 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:49:39.186749 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=95061950-7b0f-418a-a0e8-5bc8dd4ea348, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[647aad74-49b7-4d9a-8fac-32f461ab7633], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:8d:cc:69', name='lrp-69fc8e8f-5526-49d2-8152-f9475339ec36', networks=['172.24.5.248/24', '2001:db8::8e/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:49:42.176122 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8a34172f-1ea1-459b-9020-29f9ad56798d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b', 'neutron:subnet_ids': '5c58a48c-76f6-445a-a3d4-89544826020d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:81:81:17', name='lrp-ce37ec46-7ee4-4fbe-9dba-58cb6f6d866f', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:49:42.212359 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:49:42.212983 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf', 'neutron:router_id': 'bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:49:42.213358 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:49:52.210904 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:50:23.775572 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f964f68a-ffd4-44ed-9480-018bd14ad6ef, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7c299f20-615d-4544-ae5d-1f483d19637c', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[e5a231bc-4fc6-405e-848a-e141aa0c45d1], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:a3:7f:1c', name='lrp-8e70bb44-eb94-410f-bbb7-4f4bc909f710', networks=['172.24.5.212/24', '2001:db8::1c3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:50:26.632963 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=310bb59d-9f79-4241-93e1-f3239ccc6970, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7c299f20-615d-4544-ae5d-1f483d19637c', 'neutron:subnet_ids': '941daede-9c33-4be1-b302-d77c162d3931'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3c:ae:53', name='lrp-3449a8ee-36a1-485c-9867-65e9884ef63c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:50:26.676887 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:50:26.680222 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '6d115e20-1eca-49ce-9c28-746b0b2d702c', 'neutron:router_id': '7c299f20-615d-4544-ae5d-1f483d19637c'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:50:26.681437 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:50:36.674534 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:51:11.375355 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:51:11.386685 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:51:11.386685 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, security_groups=2, routers=1, router_ports=1 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:51:11.386685 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Number of inconsistencies found at delete: router_ports=3 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:51:11.386685 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource 94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:51:11.426048 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf, resource={'id': '94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf', 'name': 'tempest-network-smoke--1006200960', 'tenant_id': '3ed45ea6b8bf4c088a82e20298550a3d', 'project_id': '3ed45ea6b8bf4c088a82e20298550a3d', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['5c58a48c-76f6-445a-a3d4-89544826020d'], 'standard_attr_id': 2541, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:49:37Z', 'updated_at': '2025-11-24T19:49:39Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30057}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.426470 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf, col_values=(('external_ids', {'neutron:network_name': 'tempest-network-smoke--1006200960', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.427109 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-995b08ad-f367-4d90-8c52-6ca82efc3b65, external_ids_update=None, columns={'tag': 30057}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.461687 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Successfully bumped revision number for resource 94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf (type: networks) to 2 Nov 24 14:51:11.461950 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource 862c2202-5b0d-4378-be5c-525eda1e5a73 (type: security_groups) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:51:11.495611 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Successfully bumped revision number for resource 862c2202-5b0d-4378-be5c-525eda1e5a73 (type: security_groups) to 2 Nov 24 14:51:11.495869 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource f7947e0d-e152-4366-af90-558888b37f1b (type: security_groups) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:51:11.530785 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Successfully bumped revision number for resource f7947e0d-e152-4366-af90-558888b37f1b (type: security_groups) to 2 Nov 24 14:51:11.531006 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:51:11.647381 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b, resource={'id': 'bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b', 'name': 'tempest-TestSecurityGroupsBasicOps-router-111431817', 'tenant_id': '3ed45ea6b8bf4c088a82e20298550a3d', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.248'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::8e'}], 'enable_snat': True}, 'gw_port_id': '69fc8e8f-5526-49d2-8152-f9475339ec36', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.248', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::8e', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:49:38Z', 'updated_at': '2025-11-24T19:49:41Z', 'revision_number': 3, 'project_id': '3ed45ea6b8bf4c088a82e20298550a3d'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.647735 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b, columns={'external_ids': {'neutron:router_name': 'tempest-TestSecurityGroupsBasicOps-router-111431817', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.648060 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "69fc8e8f-5526-49d2-8152-f9475339ec36"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.648287 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "69fc8e8f-5526-49d2-8152-f9475339ec36"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.741195 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Successfully bumped revision number for resource bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b (type: routers) to 3 Nov 24 14:51:11.741380 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource 69fc8e8f-5526-49d2-8152-f9475339ec36 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:51:11.866309 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-69fc8e8f-5526-49d2-8152-f9475339ec36, resource={'id': '69fc8e8f-5526-49d2-8152-f9475339ec36', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:cc:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2545, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.248'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::8e'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:49:38Z', 'updated_at': '2025-11-24T19:49:40Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.866847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-69fc8e8f-5526-49d2-8152-f9475339ec36, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::8e/64', '172.24.5.248/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.867324 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=69fc8e8f-5526-49d2-8152-f9475339ec36, lrouter_port=lrp-69fc8e8f-5526-49d2-8152-f9475339ec36, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:11.901336 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Successfully bumped revision number for resource 69fc8e8f-5526-49d2-8152-f9475339ec36 (type: router_ports) to 5 Nov 24 14:51:11.901503 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource 28613fdd-73fc-460b-b403-a7c16b0a238c (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:51:11.902010 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] delete_revision(28613fdd-73fc-460b-b403-a7c16b0a238c) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:51:11.907898 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource 93491d57-7489-4b18-be54-4d7ae61520d2 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:51:11.908268 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] delete_revision(93491d57-7489-4b18-be54-4d7ae61520d2) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:51:11.913460 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Fixing resource e6499fc1-2b6b-4aec-9a1b-6fd09b9a1aa1 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:51:11.913915 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] delete_revision(e6499fc1-2b6b-4aec-9a1b-6fd09b9a1aa1) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:51:11.921866 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd843a11-06da-4ea2-bae5-5f2a8163fff0 None None] Maintenance task: Synchronization completed (took 0.54 seconds) Nov 24 14:51:17.886712 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=310bb59d-9f79-4241-93e1-f3239ccc6970, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-7c299f20-615d-4544-ae5d-1f483d19637c', 'neutron:subnet_ids': '941daede-9c33-4be1-b302-d77c162d3931'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3c:ae:53', name='lrp-3449a8ee-36a1-485c-9867-65e9884ef63c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:51:17.888168 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-6d115e20-1eca-49ce-9c28-746b0b2d702c, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-7c299f20-615d-4544-ae5d-1f483d19637c Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:18.743021 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:51:18.743523 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:51:18.743523 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-7c299f20-615d-4544-ae5d-1f483d19637c Nov 24 14:51:18.743523 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:51:21.916865 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=213,neutron:UPDATE=5,neutron:DELETE=3 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:51:26.750384 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8a34172f-1ea1-459b-9020-29f9ad56798d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b', 'neutron:subnet_ids': '5c58a48c-76f6-445a-a3d4-89544826020d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:81:81:17', name='lrp-ce37ec46-7ee4-4fbe-9dba-58cb6f6d866f', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:51:26.752166 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-94e883f5-b1d1-4eb5-b6c7-d57590dbb0bf, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:51:27.533701 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:51:27.534039 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:51:27.534039 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-bf14f9f2-7264-40e5-9cf1-bedcb5c42a9b Nov 24 14:51:27.534039 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:51:29.800095 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bc0edc67-ccc0-4413-900b-306aef488463, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ca12a262-bdb3-454c-8146-821adde842cc', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[c84d4300-85ad-4f6d-8944-e0b0f2eb9322], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:67:35:09', name='lrp-b2c2259f-9bbb-4fdb-9752-70d1be2ad9b6', networks=['172.24.5.238/24', '2001:db8::33/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:51:32.597085 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c3d625dc-b3e3-4319-97d3-351940118468, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-97972c4a-09b6-419e-bce1-dea32be3f265', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ca12a262-bdb3-454c-8146-821adde842cc', 'neutron:subnet_ids': '52768e01-489b-4a81-84c0-347d36f6dd2b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b9:74:63', name='lrp-e7330417-a24f-4564-b485-2c08c0e13ae7', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:51:32.634540 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-97972c4a-09b6-419e-bce1-dea32be3f265 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:51:32.635282 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-97972c4a-09b6-419e-bce1-dea32be3f265, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '97972c4a-09b6-419e-bce1-dea32be3f265', 'neutron:router_id': 'ca12a262-bdb3-454c-8146-821adde842cc'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:32.635625 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-97972c4a-09b6-419e-bce1-dea32be3f265, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:51:42.633720 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:53:00.629169 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c3d625dc-b3e3-4319-97d3-351940118468, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-97972c4a-09b6-419e-bce1-dea32be3f265', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ca12a262-bdb3-454c-8146-821adde842cc', 'neutron:subnet_ids': '52768e01-489b-4a81-84c0-347d36f6dd2b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b9:74:63', name='lrp-e7330417-a24f-4564-b485-2c08c0e13ae7', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:53:00.630471 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-97972c4a-09b6-419e-bce1-dea32be3f265, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ca12a262-bdb3-454c-8146-821adde842cc Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:53:01.373067 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:53:01.373641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:53:01.373641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ca12a262-bdb3-454c-8146-821adde842cc Nov 24 14:53:01.373641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:53:06.248823 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7d8b3c3e-d74a-40cb-b3e8-17c2b6e880ec, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[f19ab0cd-3f2a-4b92-9319-09611185be6a], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:4b:ab:e0', name='lrp-10d0fc7d-e497-4601-8496-d1e5dac572b1', networks=['172.24.5.226/24', '2001:db8::3d2/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:53:09.268831 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=4e6907dc-14c8-4e35-bf8d-b038c46d06bb, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0db47855-4494-4007-af9f-1f5448cdc5fb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b', 'neutron:subnet_ids': '420052a7-80d3-49af-bc75-7340b899be4a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:03:3d:86', name='lrp-e25229e4-6975-4d2b-a441-4c370f9009c5', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:53:09.309151 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-0db47855-4494-4007-af9f-1f5448cdc5fb synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:53:09.309694 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-0db47855-4494-4007-af9f-1f5448cdc5fb, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '0db47855-4494-4007-af9f-1f5448cdc5fb', 'neutron:router_id': '19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:53:09.310661 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-0db47855-4494-4007-af9f-1f5448cdc5fb, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:53:12.066204 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=19b2c910-303d-4864-85eb-1c25667ff79f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[1c7941cf-9961-457f-9fdc-feca64ed75a3], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:6d:56:f4', name='lrp-fe292cf9-3abc-4e03-b9d2-f41fa6791a9d', networks=['172.24.5.56/24', '2001:db8::1d9/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:53:14.424866 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dae6d139-cd2c-4164-9f35-e09c941fb1e1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-9d0c020d-61be-499f-a6eb-67ad60cad020', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7', 'neutron:subnet_ids': 'fea0f0a9-f28d-4fd2-9810-f4ee7a8c247f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:5b:78:41', name='lrp-d1c2a03b-8241-4543-8cc1-ffaf73440a98', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:53:14.460415 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-9d0c020d-61be-499f-a6eb-67ad60cad020 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:53:14.460860 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-9d0c020d-61be-499f-a6eb-67ad60cad020, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '9d0c020d-61be-499f-a6eb-67ad60cad020', 'neutron:router_id': '5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:53:14.461136 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-9d0c020d-61be-499f-a6eb-67ad60cad020, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:53:24.459222 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:54:14.810822 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=4e6907dc-14c8-4e35-bf8d-b038c46d06bb, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0db47855-4494-4007-af9f-1f5448cdc5fb', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b', 'neutron:subnet_ids': '420052a7-80d3-49af-bc75-7340b899be4a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:03:3d:86', name='lrp-e25229e4-6975-4d2b-a441-4c370f9009c5', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:54:14.813199 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-0db47855-4494-4007-af9f-1f5448cdc5fb, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:15.284699 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:54:15.285240 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:54:15.285240 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-19c14a4d-c5d0-46cb-8fb2-7e18a7d0634b Nov 24 14:54:15.285240 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:54:16.519685 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dae6d139-cd2c-4164-9f35-e09c941fb1e1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-9d0c020d-61be-499f-a6eb-67ad60cad020', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7', 'neutron:subnet_ids': 'fea0f0a9-f28d-4fd2-9810-f4ee7a8c247f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:5b:78:41', name='lrp-d1c2a03b-8241-4543-8cc1-ffaf73440a98', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:54:16.520873 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-9d0c020d-61be-499f-a6eb-67ad60cad020, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7 Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:17.033728 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:54:17.034187 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:54:17.034187 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-5bdced07-4a58-4a2c-a9e1-ad7c9c89e1f7 Nov 24 14:54:17.034187 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:54:21.421799 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=fc80cf39-841e-482a-8988-30858524aa74, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b1af61aa-23fd-44a3-aed9-31a8bb102138', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[ebf536a6-05d5-44a0-9e00-f2fd634109ba], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c2:41:c5', name='lrp-225d3635-4a3e-49ea-a358-750cb59449c8', networks=['172.24.5.231/24', '2001:db8::2e5/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:54:23.130768 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=21602d40-0824-4bff-9487-10d55265e2aa, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b1af61aa-23fd-44a3-aed9-31a8bb102138', 'neutron:subnet_ids': 'a10e3179-97a3-4e88-99f8-09bfd02be805'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:6f:c5:fb', name='lrp-b4cd8647-3330-43dd-8c85-4300587cb570', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:54:23.176810 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:54:23.178000 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0', 'neutron:router_id': 'b1af61aa-23fd-44a3-aed9-31a8bb102138'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:54:23.178249 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:54:33.174445 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=17 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:54:55.642499 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=21602d40-0824-4bff-9487-10d55265e2aa, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-b1af61aa-23fd-44a3-aed9-31a8bb102138', 'neutron:subnet_ids': 'a10e3179-97a3-4e88-99f8-09bfd02be805'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:6f:c5:fb', name='lrp-b4cd8647-3330-43dd-8c85-4300587cb570', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:54:55.644775 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-63a64a06-37eb-4a0e-9b21-1ea3e5c1cec0, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b1af61aa-23fd-44a3-aed9-31a8bb102138 Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 14:54:56.213473 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 14:54:56.214038 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 14:54:56.214038 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b1af61aa-23fd-44a3-aed9-31a8bb102138 Nov 24 14:54:56.214038 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 14:55:00.217162 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=58cb1c79-1926-4522-9728-2ea9c8647c82, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[c4ba83ac-dd35-431f-a22c-bac265add7e2], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3e:72:49', name='lrp-3098cb26-e6cc-4d24-a9ad-1895a7af2ee0', networks=['172.24.5.123/24', '2001:db8::81/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:55:02.524725 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd3fa808-89b2-450f-9ad4-dbdc327b513d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c8da6677-004d-409b-b440-e36535549cc8', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7', 'neutron:subnet_ids': '6e25392c-59b3-4e70-b67e-08dbeb70362f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3e:04:0e', name='lrp-951062da-2262-4f4f-9c5f-a82a9bae9e73', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:55:02.571689 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-c8da6677-004d-409b-b440-e36535549cc8 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:55:02.572522 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-c8da6677-004d-409b-b440-e36535549cc8, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'c8da6677-004d-409b-b440-e36535549cc8', 'neutron:router_id': '4ad29ab3-e442-4faa-86a4-91947ce315b7'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:55:02.572878 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-c8da6677-004d-409b-b440-e36535549cc8, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:55:05.022313 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8276011f-0736-4deb-a2d3-3057f20fa825, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-04e0f402-7593-40d7-abfc-e2c198938ff9', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[4761ffb6-0b22-4c1e-b9f0-9b684122bfbf], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b1:3a:ed', name='lrp-c53b0a1a-46c6-4644-802e-2b3531784f91', networks=['172.24.5.94/24', '2001:db8::1d3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:55:06.332961 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ae4a5c67-15dd-465e-b583-d2d3ea76e0b5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-04e0f402-7593-40d7-abfc-e2c198938ff9', 'neutron:subnet_ids': '4ab3064c-711b-465d-b4c1-4a0b255cf641'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:40:7a:9c', name='lrp-b9126b1b-2024-4ce6-ba61-3906049010b7', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 14:55:06.373691 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 14:55:06.373691 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '0a9706e6-e9e2-481c-9c58-c003eb6db6e8', 'neutron:router_id': '04e0f402-7593-40d7-abfc-e2c198938ff9'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:55:06.373691 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:55:16.369386 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 14:56:11.376724 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 14:56:11.386824 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 14:56:11.387034 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Number of inconsistencies found at create/update: networks=2, routers=2, router_ports=2 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:56:11.387216 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Number of inconsistencies found at delete: router_ports=6 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 14:56:11.387387 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource c8da6677-004d-409b-b440-e36535549cc8 (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:11.419748 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-c8da6677-004d-409b-b440-e36535549cc8, resource={'id': 'c8da6677-004d-409b-b440-e36535549cc8', 'name': 'tempest-TestVolumeBootPattern-205662652-network', 'tenant_id': '1a3c273bf795497b9cc2366a1591c594', 'project_id': '1a3c273bf795497b9cc2366a1591c594', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['6e25392c-59b3-4e70-b67e-08dbeb70362f'], 'standard_attr_id': 2664, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:54:58Z', 'updated_at': '2025-11-24T19:54:58Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21953}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.420172 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-c8da6677-004d-409b-b440-e36535549cc8, col_values=(('external_ids', {'neutron:network_name': 'tempest-TestVolumeBootPattern-205662652-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.420751 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-cceefa45-4e7e-42d4-b325-0fff5510893d, external_ids_update=None, columns={'tag': 21953}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.456981 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource c8da6677-004d-409b-b440-e36535549cc8 (type: networks) to 2 Nov 24 14:56:11.457183 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 0a9706e6-e9e2-481c-9c58-c003eb6db6e8 (type: networks) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:11.488490 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8, resource={'id': '0a9706e6-e9e2-481c-9c58-c003eb6db6e8', 'name': 'tempest-TestVolumeBootPattern-1698944670-network', 'tenant_id': '71b1f4c0d3e840548feb8429143ab1ef', 'project_id': '71b1f4c0d3e840548feb8429143ab1ef', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['4ab3064c-711b-465d-b4c1-4a0b255cf641'], 'standard_attr_id': 2676, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-24T19:55:03Z', 'updated_at': '2025-11-24T19:55:03Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17738}, resource_type=networks, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.488916 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8, col_values=(('external_ids', {'neutron:network_name': 'tempest-TestVolumeBootPattern-1698944670-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.489403 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-f01932e4-fae4-41d0-8b8c-5b3d5d388e89, external_ids_update=None, columns={'tag': 17738}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.523096 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource 0a9706e6-e9e2-481c-9c58-c003eb6db6e8 (type: networks) to 2 Nov 24 14:56:11.523096 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 4ad29ab3-e442-4faa-86a4-91947ce315b7 (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:11.610941 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7, resource={'id': '4ad29ab3-e442-4faa-86a4-91947ce315b7', 'name': 'tempest-TestVolumeBootPattern-205662652-router', 'tenant_id': '1a3c273bf795497b9cc2366a1591c594', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.123'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::81'}], 'enable_snat': True}, 'gw_port_id': '3098cb26-e6cc-4d24-a9ad-1895a7af2ee0', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.123', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::81', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:54:59Z', 'updated_at': '2025-11-24T19:55:01Z', 'revision_number': 3, 'project_id': '1a3c273bf795497b9cc2366a1591c594'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.611185 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7, columns={'external_ids': {'neutron:router_name': 'tempest-TestVolumeBootPattern-205662652-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.611396 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "3098cb26-e6cc-4d24-a9ad-1895a7af2ee0"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.611545 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "3098cb26-e6cc-4d24-a9ad-1895a7af2ee0"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.687188 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource 4ad29ab3-e442-4faa-86a4-91947ce315b7 (type: routers) to 3 Nov 24 14:56:11.687306 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 04e0f402-7593-40d7-abfc-e2c198938ff9 (type: routers) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:11.744638 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-04e0f402-7593-40d7-abfc-e2c198938ff9, resource={'id': '04e0f402-7593-40d7-abfc-e2c198938ff9', 'name': 'tempest-TestVolumeBootPattern-1698944670-router', 'tenant_id': '71b1f4c0d3e840548feb8429143ab1ef', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.94'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::1d3'}], 'enable_snat': True}, 'gw_port_id': 'c53b0a1a-46c6-4644-802e-2b3531784f91', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'external_fixed_ips': [{'ip_address': '172.24.5.94', 'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e'}, {'ip_address': '2001:db8::1d3', 'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-24T19:55:04Z', 'updated_at': '2025-11-24T19:55:05Z', 'revision_number': 3, 'project_id': '71b1f4c0d3e840548feb8429143ab1ef'}, resource_type=routers, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.744897 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-04e0f402-7593-40d7-abfc-e2c198938ff9, columns={'external_ids': {'neutron:router_name': 'tempest-TestVolumeBootPattern-1698944670-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.745126 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "c53b0a1a-46c6-4644-802e-2b3531784f91"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.745274 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "c53b0a1a-46c6-4644-802e-2b3531784f91"')], if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.779682 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource 04e0f402-7593-40d7-abfc-e2c198938ff9 (type: routers) to 3 Nov 24 14:56:11.779766 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 3098cb26-e6cc-4d24-a9ad-1895a7af2ee0 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:11.905894 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-3098cb26-e6cc-4d24-a9ad-1895a7af2ee0, resource={'id': '3098cb26-e6cc-4d24-a9ad-1895a7af2ee0', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:72:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ad29ab3-e442-4faa-86a4-91947ce315b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2669, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.123'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::81'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:54:59Z', 'updated_at': '2025-11-24T19:55:01Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.907641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-3098cb26-e6cc-4d24-a9ad-1895a7af2ee0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.123/24', '2001:db8::81/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.907641 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=3098cb26-e6cc-4d24-a9ad-1895a7af2ee0, lrouter_port=lrp-3098cb26-e6cc-4d24-a9ad-1895a7af2ee0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:11.930323 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource 3098cb26-e6cc-4d24-a9ad-1895a7af2ee0 (type: router_ports) to 5 Nov 24 14:56:11.930436 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource c53b0a1a-46c6-4644-802e-2b3531784f91 (type: router_ports) at create/update {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 24 14:56:12.025582 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-c53b0a1a-46c6-4644-802e-2b3531784f91, resource={'id': 'c53b0a1a-46c6-4644-802e-2b3531784f91', 'name': '', 'network_id': 'ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:3a:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '04e0f402-7593-40d7-abfc-e2c198938ff9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2681, 'fixed_ips': [{'subnet_id': '8d13a864-1ad7-4463-b65a-a72487ff463e', 'ip_address': '172.24.5.94'}, {'subnet_id': '710ff830-0879-4cc6-9017-fcbff27d7038', 'ip_address': '2001:db8::1d3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005533992.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-24T19:55:04Z', 'updated_at': '2025-11-24T19:55:05Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:12.025771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-c53b0a1a-46c6-4644-802e-2b3531784f91, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-04e0f402-7593-40d7-abfc-e2c198938ff9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::1d3/64', '172.24.5.94/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:12.025771 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=c53b0a1a-46c6-4644-802e-2b3531784f91, lrouter_port=lrp-c53b0a1a-46c6-4644-802e-2b3531784f91, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 14:56:12.061880 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Successfully bumped revision number for resource c53b0a1a-46c6-4644-802e-2b3531784f91 (type: router_ports) to 5 Nov 24 14:56:12.062117 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 10d0fc7d-e497-4601-8496-d1e5dac572b1 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.062502 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(10d0fc7d-e497-4601-8496-d1e5dac572b1) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.067261 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 225d3635-4a3e-49ea-a358-750cb59449c8 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.067632 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(225d3635-4a3e-49ea-a358-750cb59449c8) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.073037 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 69fc8e8f-5526-49d2-8152-f9475339ec36 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.073384 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(69fc8e8f-5526-49d2-8152-f9475339ec36) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.078061 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource 8e70bb44-eb94-410f-bbb7-4f4bc909f710 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.078408 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(8e70bb44-eb94-410f-bbb7-4f4bc909f710) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.082656 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource b2c2259f-9bbb-4fdb-9752-70d1be2ad9b6 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.082996 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(b2c2259f-9bbb-4fdb-9752-70d1be2ad9b6) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.088086 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Fixing resource fe292cf9-3abc-4e03-b9d2-f41fa6791a9d (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 14:56:12.088424 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] delete_revision(fe292cf9-3abc-4e03-b9d2-f41fa6791a9d) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 14:56:12.093668 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b5e3e9d0-26e2-4227-b9ac-0afd7ff34b2a None None] Maintenance task: Synchronization completed (took 0.71 seconds) Nov 24 14:56:22.090943 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=376,neutron:UPDATE=6,neutron:DELETE=6 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 15:00:07.975390 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd3fa808-89b2-450f-9ad4-dbdc327b513d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c8da6677-004d-409b-b440-e36535549cc8', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7', 'neutron:subnet_ids': '6e25392c-59b3-4e70-b67e-08dbeb70362f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3e:04:0e', name='lrp-951062da-2262-4f4f-9c5f-a82a9bae9e73', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:07.977419 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-c8da6677-004d-409b-b440-e36535549cc8, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7 Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:08.711524 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 15:00:08.712132 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 15:00:08.712132 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4ad29ab3-e442-4faa-86a4-91947ce315b7 Nov 24 15:00:08.712132 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 15:00:10.046478 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ae4a5c67-15dd-465e-b583-d2d3ea76e0b5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-04e0f402-7593-40d7-abfc-e2c198938ff9', 'neutron:subnet_ids': '4ab3064c-711b-465d-b4c1-4a0b255cf641'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:40:7a:9c', name='lrp-b9126b1b-2024-4ce6-ba61-3906049010b7', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:10.048827 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-0a9706e6-e9e2-481c-9c58-c003eb6db6e8, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-04e0f402-7593-40d7-abfc-e2c198938ff9 Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:10.627529 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 15:00:10.627906 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 15:00:10.627906 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-04e0f402-7593-40d7-abfc-e2c198938ff9 Nov 24 15:00:10.627906 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 15:00:42.966521 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=4f6a3abc-872f-45ac-907d-736dfa263ee8, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-86453a13-9ec4-48f3-9c71-b44793e3c32b', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[e17a40b1-8e23-4cf8-acc6-bf96c13ca293], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d4:38:b2', name='lrp-cc4c89a2-2a4c-48ce-91dd-188de2046a6f', networks=['172.24.5.213/24', '2001:db8::247/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:45.529805 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ed3ea9a4-4418-4517-9366-810795cfdc48, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1c1f35de-36cf-4855-a806-040c9238cb3b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-86453a13-9ec4-48f3-9c71-b44793e3c32b', 'neutron:subnet_ids': '103b8270-6c18-4f0d-8269-97a760686079'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:6e:c6', name='lrp-44a6eedb-0395-4349-9c90-40b67095a8e1', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:45.572688 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-1c1f35de-36cf-4855-a806-040c9238cb3b synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 15:00:45.573536 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-1c1f35de-36cf-4855-a806-040c9238cb3b, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '1c1f35de-36cf-4855-a806-040c9238cb3b', 'neutron:router_id': '86453a13-9ec4-48f3-9c71-b44793e3c32b'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:45.574163 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-1c1f35de-36cf-4855-a806-040c9238cb3b, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:48.862329 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=210dca94-594c-42dd-96fd-cc271a47df29, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-ebf09b6a-13a1-4edc-827d-0b22b6c7b4f1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-11ca81a0-677f-4675-b814-2fdfbac645cd', 'neutron:subnet_ids': '8d13a864-1ad7-4463-b65a-a72487ff463e 710ff830-0879-4cc6-9017-fcbff27d7038'}, gateway_chassis=[f57228f8-0b1c-41d5-89cc-7e02214be197], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:63:5d:b2', name='lrp-2a118a8e-4f00-4f02-b83b-d30997709cb3', networks=['172.24.5.171/24', '2001:db8::18/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:50.427757 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5e56f417-2d03-4cf9-8c0f-90aee97e2035, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a319487c-0e66-44bc-996a-4f687504c912', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-11ca81a0-677f-4675-b814-2fdfbac645cd', 'neutron:subnet_ids': '70cf581b-ca25-4c9e-a55d-77369355d9ae'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c4:47:0d', name='lrp-5f690cdc-bb91-40ec-a62e-3f8b8718c295', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:50.461397 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-a319487c-0e66-44bc-996a-4f687504c912 synchronized; highest priority chassis 6615db93-4bae-432f-bd22-11ed2f5a7804 Nov 24 15:00:50.462172 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-a319487c-0e66-44bc-996a-4f687504c912, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'a319487c-0e66-44bc-996a-4f687504c912', 'neutron:router_id': '11ca81a0-677f-4675-b814-2fdfbac645cd'}}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:50.462712 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-a319487c-0e66-44bc-996a-4f687504c912, chassis=6615db93-4bae-432f-bd22-11ed2f5a7804, priority=1, columns={}) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:52.475344 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ed3ea9a4-4418-4517-9366-810795cfdc48, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1c1f35de-36cf-4855-a806-040c9238cb3b', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-86453a13-9ec4-48f3-9c71-b44793e3c32b', 'neutron:subnet_ids': '103b8270-6c18-4f0d-8269-97a760686079'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:6e:c6', name='lrp-44a6eedb-0395-4349-9c90-40b67095a8e1', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:52.476129 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-1c1f35de-36cf-4855-a806-040c9238cb3b, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-86453a13-9ec4-48f3-9c71-b44793e3c32b Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:53.023847 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 15:00:53.024307 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 15:00:53.024307 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-86453a13-9ec4-48f3-9c71-b44793e3c32b Nov 24 15:00:53.024307 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 15:00:54.305944 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5e56f417-2d03-4cf9-8c0f-90aee97e2035, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a319487c-0e66-44bc-996a-4f687504c912', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-11ca81a0-677f-4675-b814-2fdfbac645cd', 'neutron:subnet_ids': '70cf581b-ca25-4c9e-a55d-77369355d9ae'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c4:47:0d', name='lrp-5f690cdc-bb91-40ec-a62e-3f8b8718c295', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=113915) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 24 15:00:54.309530 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-a319487c-0e66-44bc-996a-4f687504c912, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=113915) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-11ca81a0-677f-4675-b814-2fdfbac645cd Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 24 15:00:54.851733 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 24 15:00:54.851980 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 24 15:00:54.851980 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-11ca81a0-677f-4675-b814-2fdfbac645cd Nov 24 15:00:54.851980 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: ERROR ovsdbapp.event Nov 24 15:01:00.460862 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG dbcounter [-] [113915] Writing DB stats neutron:SELECT=34 {{(pid=113915) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 24 15:01:11.377499 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=113915) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 24 15:01:11.385600 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 24 15:01:11.385738 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Number of inconsistencies found at delete: router_ports=4 {{(pid=113915) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 24 15:01:11.385860 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 2a118a8e-4f00-4f02-b83b-d30997709cb3 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 15:01:11.386113 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(2a118a8e-4f00-4f02-b83b-d30997709cb3) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 15:01:11.390397 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource 3098cb26-e6cc-4d24-a9ad-1895a7af2ee0 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 15:01:11.390613 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(3098cb26-e6cc-4d24-a9ad-1895a7af2ee0) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 15:01:11.393756 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource c53b0a1a-46c6-4644-802e-2b3531784f91 (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 15:01:11.394046 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(c53b0a1a-46c6-4644-802e-2b3531784f91) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 15:01:11.399146 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Fixing resource cc4c89a2-2a4c-48ce-91dd-188de2046a6f (type: router_ports) at delete {{(pid=113915) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 24 15:01:11.399343 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: DEBUG neutron.db.ovn_revision_numbers_db [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] delete_revision(cc4c89a2-2a4c-48ce-91dd-188de2046a6f) {{(pid=113915) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 24 15:01:11.402246 np0005533992.novalocal neutron-ovn-maintenance-worker[113915]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b8509b8b-6033-4622-9ac2-3475afce4dca None None] Maintenance task: Synchronization completed (took 0.02 seconds)