Nov 21 15:30:20.478760 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:30:34.799133 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=204c8501-9ed7-49e2-8ab5-ac79b63dfb14, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f3c97b04-1071-4209-9a72-0a55ea9de993', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[b77fdc62-96db-40b0-b3f1-1caf83cd3c7e], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:16:f5:73', name='lrp-4745d69c-68d3-4af3-8272-3be066f36ca0', networks=['172.24.5.172/24', '2001:db8::155/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:30:36.140466 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d1df5a2f-ab6b-4c7b-9744-dc8f64c3a990, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f3c97b04-1071-4209-9a72-0a55ea9de993', 'neutron:subnet_ids': 'e5fb57fa-fd4f-433c-a31f-7af99424af7f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:dc:5f:41', name='lrp-75e99c94-e03d-4bb5-8401-fd79f48cd25b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:30:36.185075 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:30:36.187433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'a19e02ff-4103-4ccd-9547-b48bb56592e5', 'neutron:router_id': 'f3c97b04-1071-4209-9a72-0a55ea9de993'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:30:36.187722 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:30:37.415711 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5673bf5e-ec16-4f4d-a36b-d38d08c8fa61, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-e1306d7a-4b09-4bec-9a15-a75d90f967bb', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-8c1f990e-28e5-4ca1-add5-01f45eca17c5', 'neutron:subnet_ids': 'a0979f93-8db4-42e1-8c32-313b5a7a832e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:84:6b:5d', name='lrp-8bf51cc1-c6cb-4d5e-b293-2e0850ba01cf', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:30:37.417686 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-e1306d7a-4b09-4bec-9a15-a75d90f967bb, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8c1f990e-28e5-4ca1-add5-01f45eca17c5 Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:30:38.122839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:30:38.123150 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:30:38.123150 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8c1f990e-28e5-4ca1-add5-01f45eca17c5 Nov 21 15:30:38.123150 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:30:46.183919 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:31:04.963346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=e56d36ea-425f-4299-a545-e9ee57ea2cdf, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-81f588e0-1180-4284-9b1b-aedffed3bc9f', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[cceacfd5-20db-4ff5-b800-be77d9ebaf08], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:62:6c:dd', name='lrp-25b41ea4-20cc-4418-bc77-6aba1f7fc414', networks=['172.24.5.247/24', '2001:db8::15c/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:31:07.408155 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=91e96c66-1d0c-4eab-8b85-c902ca161564, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-81f588e0-1180-4284-9b1b-aedffed3bc9f', 'neutron:subnet_ids': '06de08ac-6e2b-4726-acd4-b6a4a00a5200'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:38:d5:fd', name='lrp-9c3cfa8a-b373-4b68-916a-656386f51b3b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:31:07.442418 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:31:07.443478 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '950af5c2-0dc8-4b40-bfdf-97979b98b9da', 'neutron:router_id': '81f588e0-1180-4284-9b1b-aedffed3bc9f'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:31:07.443478 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:31:17.441352 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:31:34.750455 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=91e96c66-1d0c-4eab-8b85-c902ca161564, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-81f588e0-1180-4284-9b1b-aedffed3bc9f', 'neutron:subnet_ids': '06de08ac-6e2b-4726-acd4-b6a4a00a5200'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:38:d5:fd', name='lrp-9c3cfa8a-b373-4b68-916a-656386f51b3b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:31:34.752549 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-950af5c2-0dc8-4b40-bfdf-97979b98b9da, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-81f588e0-1180-4284-9b1b-aedffed3bc9f Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:31:35.395801 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:31:35.396135 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:31:35.396135 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-81f588e0-1180-4284-9b1b-aedffed3bc9f Nov 21 15:31:35.396135 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:31:40.248990 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7d256836-c39a-4902-bd89-3d5c394324f3, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d127e7c0-6464-4e69-a036-0056337ebf47', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[4f8969b0-bcb3-402b-9b24-0c5d12c43de5], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ff:80:50', name='lrp-1f29262b-377e-42e6-ab48-10e77fa5fa0d', networks=['172.24.5.205/24', '2001:db8::384/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:31:41.445491 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ccbf0f50-f8a4-4021-bd41-83287deb0bf9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d127e7c0-6464-4e69-a036-0056337ebf47', 'neutron:subnet_ids': 'e6074b42-a7d0-4db4-8b80-40acfabdcecd'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0e:06:64', name='lrp-74dc4285-552e-41bc-b977-07c1f6c6006e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:31:41.512838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:31:41.512838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '599c5cb6-9caf-4350-827b-5ef776ffffa1', 'neutron:router_id': 'd127e7c0-6464-4e69-a036-0056337ebf47'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:31:41.512838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:31:51.506400 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:32:03.578502 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ccbf0f50-f8a4-4021-bd41-83287deb0bf9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-d127e7c0-6464-4e69-a036-0056337ebf47', 'neutron:subnet_ids': 'e6074b42-a7d0-4db4-8b80-40acfabdcecd'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0e:06:64', name='lrp-74dc4285-552e-41bc-b977-07c1f6c6006e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:03.581066 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-599c5cb6-9caf-4350-827b-5ef776ffffa1, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-d127e7c0-6464-4e69-a036-0056337ebf47 Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:04.182263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:32:04.183211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:32:04.183211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-d127e7c0-6464-4e69-a036-0056337ebf47 Nov 21 15:32:04.183211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:32:51.081273 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5c59caab-57e6-45ec-bfb4-79da66367b3a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-078b95ac-ce06-44aa-b0c4-97088be5efc4', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-554c8284-6da3-4447-bfbc-8be1edefaa1e', 'neutron:subnet_ids': '18cdeb24-6c9d-4807-a062-94fe9a5cf714'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:69:7c:67', name='lrp-d62794a5-a840-4739-bdea-51166bb2eecd', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:51.083153 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-078b95ac-ce06-44aa-b0c4-97088be5efc4, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-554c8284-6da3-4447-bfbc-8be1edefaa1e Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:51.834552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:32:51.834833 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:32:51.834833 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-554c8284-6da3-4447-bfbc-8be1edefaa1e Nov 21 15:32:51.834833 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:32:54.090759 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9e60f8a3-6491-46a0-80f7-3eebbefc33f9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-14571a88-1958-4a56-98b9-e32b8c738f21', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-1a06eecf-7cc4-4d86-a563-f62583161fa5', 'neutron:subnet_ids': 'f6a75eac-b381-427a-9be0-4395952fe318'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:a8:a3:10', name='lrp-ce51b6b3-d234-45dc-9a68-76d163077da5', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:54.095761 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-14571a88-1958-4a56-98b9-e32b8c738f21, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-1a06eecf-7cc4-4d86-a563-f62583161fa5 Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:54.663867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:32:54.664451 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:32:54.664451 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-1a06eecf-7cc4-4d86-a563-f62583161fa5 Nov 21 15:32:54.664451 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:32:55.480724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=52abcba9-79cc-43f5-b69b-a1d95843d861, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-0275a189-8424-4c24-b85e-5339e24be648', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[b8c5d14d-0774-41c9-b89a-f77e5da9f99f], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:22:76:7d', name='lrp-4c758934-a519-4466-8056-d166458a0414', networks=['172.24.5.9/24', '2001:db8::bd/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:57.806186 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=715817ea-d8dd-43ba-9493-b78a68eec3c5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-0275a189-8424-4c24-b85e-5339e24be648', 'neutron:subnet_ids': '76b2760b-1352-4a2f-bcbc-1cfd0fc6e452'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fa:cd:5f', name='lrp-0b354488-5cc4-4b5d-a586-b91b28c9fade', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:57.850323 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:32:57.851058 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'cc2fdb90-10f1-4d73-a255-ea1d70c946ad', 'neutron:router_id': '0275a189-8424-4c24-b85e-5339e24be648'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:57.851509 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:59.259875 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=715817ea-d8dd-43ba-9493-b78a68eec3c5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-0275a189-8424-4c24-b85e-5339e24be648', 'neutron:subnet_ids': '76b2760b-1352-4a2f-bcbc-1cfd0fc6e452'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fa:cd:5f', name='lrp-0b354488-5cc4-4b5d-a586-b91b28c9fade', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:32:59.262248 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-cc2fdb90-10f1-4d73-a255-ea1d70c946ad, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-0275a189-8424-4c24-b85e-5339e24be648 Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:32:59.849653 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:32:59.850085 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:32:59.850085 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-0275a189-8424-4c24-b85e-5339e24be648 Nov 21 15:32:59.850085 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:32:59.942456 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=82264005-36e8-46c6-bbaf-8d9ce2180f4a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ff5e57a2-0593-4db7-87f4-90fe1fd08d3e', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[e3805c59-b1d5-4da0-bb50-71bee244ff4d], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:74:2c:59', name='lrp-b5898074-c7b2-4d89-a970-fbd7ae86da9f', networks=['172.24.5.153/24', '2001:db8::399/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:01.404426 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a05e6f13-368c-4b8d-952b-34e7cc19dca1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ff5e57a2-0593-4db7-87f4-90fe1fd08d3e', 'neutron:subnet_ids': '744c57f8-b562-461b-b80e-7d1f0f8c092e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:56:37:e4', name='lrp-879bb7cf-20d5-454d-9872-7a166bbdce7c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:01.446467 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:33:01.449202 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'b931ca69-7f4a-4c75-9720-0f2665ff7cfc', 'neutron:router_id': 'ff5e57a2-0593-4db7-87f4-90fe1fd08d3e'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:01.449484 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:04.077889 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6a0d92ae-a747-4be9-b7f8-17fda11f312c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-069d0712-cdb9-45fa-adb5-b59713b09adf', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[aaba0ec8-2f88-452f-acf2-99f6a0b5d6ab], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ef:02:ab', name='lrp-8d902c28-2db9-4ac4-b1ba-3b975bc360fb', networks=['172.24.5.42/24', '2001:db8::277/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:04.413254 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=37064585-cd39-42f4-930c-9d63675cdd25, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[5b8764a0-b56e-4720-aa42-059c4a776b1d], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d7:f3:17', name='lrp-119af5ca-24a7-4385-a881-232e9e28b0cb', networks=['172.24.5.6/24', '2001:db8::35a/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:05.481332 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=90f1aafd-9c07-47bd-8d01-45bf3dd10c24, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-afc52f55-6018-43c4-be20-d62c34a3913c', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-069d0712-cdb9-45fa-adb5-b59713b09adf', 'neutron:subnet_ids': '1642b9cb-3b61-46fd-8a77-3e6eeff4cb55'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:57:6e:83', name='lrp-367ba569-39e1-49cc-ab92-e2adbff027b4', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:05.521616 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-afc52f55-6018-43c4-be20-d62c34a3913c synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:33:05.522033 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-afc52f55-6018-43c4-be20-d62c34a3913c, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'afc52f55-6018-43c4-be20-d62c34a3913c', 'neutron:router_id': '069d0712-cdb9-45fa-adb5-b59713b09adf'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:05.522236 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-afc52f55-6018-43c4-be20-d62c34a3913c, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:07.329181 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=43f2760e-e3da-49ff-b979-c250c93c0465, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b', 'neutron:subnet_ids': 'c490705c-0e21-407f-8f7b-06871460a621'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:da:76:f2', name='lrp-602b5243-1c69-4968-aa70-e3735d213f89', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:07.361024 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:33:07.363137 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'a1a5bee3-b50a-4473-9d0d-b681a6ce6edd', 'neutron:router_id': '4b1e976d-d87b-4cac-a8ab-679986ea3a7b'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:07.363389 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:17.360690 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=68 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:33:20.085470 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9ffe7e89-8464-4021-8ea4-c7c08a837ea3, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[e2ab6457-5605-4e80-8891-9f773a089cb8], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:27:7a:b3', name='lrp-1921be29-1635-4cf3-8ac1-1e6d485a375e', networks=['172.24.5.218/24', '2001:db8::1ca/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:21.705543 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=44cfdde9-5dde-4fea-8340-5c60a2439f0b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7', 'neutron:subnet_ids': '5d1b83c2-8d82-4afe-a142-faf5293d45bf'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fb:c9:14', name='lrp-ca407d27-9a80-483d-a7dd-d1bb355c8e99', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:21.745641 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:33:21.746027 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '8c6e2dfc-66cf-4042-a758-d3e82e07ced2', 'neutron:router_id': '8d89015a-68fb-4bce-8628-ae6c5a1549c7'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:21.746231 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:31.744735 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:33:46.524278 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=90f1aafd-9c07-47bd-8d01-45bf3dd10c24, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-afc52f55-6018-43c4-be20-d62c34a3913c', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-069d0712-cdb9-45fa-adb5-b59713b09adf', 'neutron:subnet_ids': '1642b9cb-3b61-46fd-8a77-3e6eeff4cb55'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:57:6e:83', name='lrp-367ba569-39e1-49cc-ab92-e2adbff027b4', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:46.528025 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-afc52f55-6018-43c4-be20-d62c34a3913c, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-069d0712-cdb9-45fa-adb5-b59713b09adf Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:33:47.047940 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:33:47.054468 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:33:47.054468 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-069d0712-cdb9-45fa-adb5-b59713b09adf Nov 21 15:33:47.054468 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:33:49.814300 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=0c6c630e-d9b2-41e8-bdae-e7716c67b88e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a79326c1-960d-4e35-b8bd-1a77f3cba323', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[13deecb6-bb95-4ad4-b0c4-171de4859f4e], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d4:15:b7', name='lrp-95c64618-829e-4385-9c2b-00fded1c2570', networks=['172.24.5.251/24', '2001:db8::1f7/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:51.293879 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=55237d39-4457-42e3-a0e7-015e3fe9f689, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a79326c1-960d-4e35-b8bd-1a77f3cba323', 'neutron:subnet_ids': 'aae972ea-36b9-44f3-b61d-f1e7034f05de'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:2d:85:e7', name='lrp-a62f903f-c205-453d-ab21-dae11c792e81', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:33:51.348893 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:33:51.352232 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '80c91a06-ce19-4fdb-b908-a84066bbc35f', 'neutron:router_id': 'a79326c1-960d-4e35-b8bd-1a77f3cba323'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:33:51.352232 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:01.346674 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:34:15.257705 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=55237d39-4457-42e3-a0e7-015e3fe9f689, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-a79326c1-960d-4e35-b8bd-1a77f3cba323', 'neutron:subnet_ids': 'aae972ea-36b9-44f3-b61d-f1e7034f05de'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:2d:85:e7', name='lrp-a62f903f-c205-453d-ab21-dae11c792e81', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:15.259036 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-80c91a06-ce19-4fdb-b908-a84066bbc35f, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a79326c1-960d-4e35-b8bd-1a77f3cba323 Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:16.133680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:34:16.133949 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:34:16.133949 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-a79326c1-960d-4e35-b8bd-1a77f3cba323 Nov 21 15:34:16.133949 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:34:41.358072 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a05e6f13-368c-4b8d-952b-34e7cc19dca1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ff5e57a2-0593-4db7-87f4-90fe1fd08d3e', 'neutron:subnet_ids': '744c57f8-b562-461b-b80e-7d1f0f8c092e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:56:37:e4', name='lrp-879bb7cf-20d5-454d-9872-7a166bbdce7c', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:41.358867 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=98566) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 21 15:34:41.362560 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.375664 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 21 15:34:41.375809 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=1, routers=4, router_ports=4 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:34:41.375923 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Number of inconsistencies found at delete: router_ports=9 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:34:41.376020 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 8c6e2dfc-66cf-4042-a758-d3e82e07ced2 (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.401276 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2, resource={'id': '8c6e2dfc-66cf-4042-a758-d3e82e07ced2', 'name': 'tempest-AttachVolumeMultiAttachTest-72498143-network', 'tenant_id': '3d7e4dfaffba4f68980544b539143078', 'project_id': '3d7e4dfaffba4f68980544b539143078', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['5d1b83c2-8d82-4afe-a142-faf5293d45bf'], 'standard_attr_id': 718, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:33:17Z', 'updated_at': '2025-11-21T20:33:18Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 57728}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.403200 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2, col_values=(('external_ids', {'neutron:network_name': 'tempest-AttachVolumeMultiAttachTest-72498143-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.403200 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-8b0cc172-2f87-4ede-874b-e99411a4a78a, external_ids_update=None, columns={'tag': 57728}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.422054 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 8c6e2dfc-66cf-4042-a758-d3e82e07ced2 (type: networks) to 2 Nov 21 15:34:41.422159 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource a19e02ff-4103-4ccd-9547-b48bb56592e5 (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.442613 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5, resource={'id': 'a19e02ff-4103-4ccd-9547-b48bb56592e5', 'name': 'tempest-ServerActionsTestOtherA-1971006831-network', 'tenant_id': 'ea225301c04b40fda5e588afd16ae5b4', 'project_id': 'ea225301c04b40fda5e588afd16ae5b4', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e5fb57fa-fd4f-433c-a31f-7af99424af7f'], 'standard_attr_id': 575, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:30:32Z', 'updated_at': '2025-11-21T20:30:32Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 30514}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.442613 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5, col_values=(('external_ids', {'neutron:network_name': 'tempest-ServerActionsTestOtherA-1971006831-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.444270 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-221f9416-a976-4bf4-98e8-e6337f966746, external_ids_update=None, columns={'tag': 30514}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.469145 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource a19e02ff-4103-4ccd-9547-b48bb56592e5 (type: networks) to 2 Nov 21 15:34:41.469253 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource a1a5bee3-b50a-4473-9d0d-b681a6ce6edd (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.489468 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd, resource={'id': 'a1a5bee3-b50a-4473-9d0d-b681a6ce6edd', 'name': 'tempest-TaggedAttachmentsTest-1574195212-network', 'tenant_id': 'f1e719878fc74271a310afb1f387087f', 'project_id': 'f1e719878fc74271a310afb1f387087f', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['c490705c-0e21-407f-8f7b-06871460a621'], 'standard_attr_id': 669, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:33:02Z', 'updated_at': '2025-11-21T20:33:02Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 8750}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.490003 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd, col_values=(('external_ids', {'neutron:network_name': 'tempest-TaggedAttachmentsTest-1574195212-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.490868 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-95d4540b-927a-437c-8a6d-7d92902dbf4f, external_ids_update=None, columns={'tag': 8750}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.511704 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource a1a5bee3-b50a-4473-9d0d-b681a6ce6edd (type: networks) to 2 Nov 21 15:34:41.511827 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource b931ca69-7f4a-4c75-9720-0f2665ff7cfc (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.540083 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc, resource={'id': 'b931ca69-7f4a-4c75-9720-0f2665ff7cfc', 'name': 'tempest-TaggedAttachmentsTest-1236835156-network', 'tenant_id': '30a5afe9cec24f88a410755f35be2ae4', 'project_id': '30a5afe9cec24f88a410755f35be2ae4', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['744c57f8-b562-461b-b80e-7d1f0f8c092e'], 'standard_attr_id': 657, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:32:56Z', 'updated_at': '2025-11-21T20:32:57Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 14521}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.541610 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b931ca69-7f4a-4c75-9720-0f2665ff7cfc, col_values=(('external_ids', {'neutron:network_name': 'tempest-TaggedAttachmentsTest-1236835156-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.542100 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-73ac36b6-5998-4bd5-b7f7-2a3d59a7ec39, external_ids_update=None, columns={'tag': 14521}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.568172 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource b931ca69-7f4a-4c75-9720-0f2665ff7cfc (type: networks) to 2 Nov 21 15:34:41.568328 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 51fec376-7ba1-417a-bd61-6e57ea529ce7 (type: security_groups) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.592978 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 51fec376-7ba1-417a-bd61-6e57ea529ce7 (type: security_groups) to 3 Nov 21 15:34:41.593083 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 8d89015a-68fb-4bce-8628-ae6c5a1549c7 (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.650624 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7, resource={'id': '8d89015a-68fb-4bce-8628-ae6c5a1549c7', 'name': 'tempest-AttachVolumeMultiAttachTest-72498143-router', 'tenant_id': '3d7e4dfaffba4f68980544b539143078', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.218'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::1ca'}], 'enable_snat': True}, 'gw_port_id': '1921be29-1635-4cf3-8ac1-1e6d485a375e', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'ip_address': '172.24.5.218', 'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04'}, {'ip_address': '2001:db8::1ca', 'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-21T20:33:18Z', 'updated_at': '2025-11-21T20:33:20Z', 'revision_number': 3, 'project_id': '3d7e4dfaffba4f68980544b539143078'}, resource_type=routers, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.650895 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7, columns={'external_ids': {'neutron:router_name': 'tempest-AttachVolumeMultiAttachTest-72498143-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.651076 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "1921be29-1635-4cf3-8ac1-1e6d485a375e"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.651205 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "1921be29-1635-4cf3-8ac1-1e6d485a375e"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.728364 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 8d89015a-68fb-4bce-8628-ae6c5a1549c7 (type: routers) to 3 Nov 21 15:34:41.728482 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource f3c97b04-1071-4209-9a72-0a55ea9de993 (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.785733 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-f3c97b04-1071-4209-9a72-0a55ea9de993, resource={'id': 'f3c97b04-1071-4209-9a72-0a55ea9de993', 'name': 'tempest-ServerActionsTestOtherA-1971006831-router', 'tenant_id': 'ea225301c04b40fda5e588afd16ae5b4', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.172'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::155'}], 'enable_snat': True}, 'gw_port_id': '4745d69c-68d3-4af3-8272-3be066f36ca0', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'ip_address': '172.24.5.172', 'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04'}, {'ip_address': '2001:db8::155', 'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-21T20:30:33Z', 'updated_at': '2025-11-21T20:30:35Z', 'revision_number': 3, 'project_id': 'ea225301c04b40fda5e588afd16ae5b4'}, resource_type=routers, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.786139 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-f3c97b04-1071-4209-9a72-0a55ea9de993, columns={'external_ids': {'neutron:router_name': 'tempest-ServerActionsTestOtherA-1971006831-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.786933 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "4745d69c-68d3-4af3-8272-3be066f36ca0"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.786933 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "4745d69c-68d3-4af3-8272-3be066f36ca0"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.844816 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource f3c97b04-1071-4209-9a72-0a55ea9de993 (type: routers) to 3 Nov 21 15:34:41.845122 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 4b1e976d-d87b-4cac-a8ab-679986ea3a7b (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ff5e57a2-0593-4db7-87f4-90fe1fd08d3e Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:41.905956 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:34:41.906456 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:34:41.906456 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ff5e57a2-0593-4db7-87f4-90fe1fd08d3e Nov 21 15:34:41.906456 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:34:41.910905 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b, resource={'id': '4b1e976d-d87b-4cac-a8ab-679986ea3a7b', 'name': 'tempest-TaggedAttachmentsTest-1574195212-router', 'tenant_id': 'f1e719878fc74271a310afb1f387087f', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.6'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::35a'}], 'enable_snat': True}, 'gw_port_id': '119af5ca-24a7-4385-a881-232e9e28b0cb', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'ip_address': '172.24.5.6', 'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04'}, {'ip_address': '2001:db8::35a', 'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-21T20:33:03Z', 'updated_at': '2025-11-21T20:33:05Z', 'revision_number': 3, 'project_id': 'f1e719878fc74271a310afb1f387087f'}, resource_type=routers, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.911124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b, columns={'external_ids': {'neutron:router_name': 'tempest-TaggedAttachmentsTest-1574195212-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.911286 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "119af5ca-24a7-4385-a881-232e9e28b0cb"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.911409 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "119af5ca-24a7-4385-a881-232e9e28b0cb"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:41.949584 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 4b1e976d-d87b-4cac-a8ab-679986ea3a7b (type: routers) to 3 Nov 21 15:34:41.949711 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource ff5e57a2-0593-4db7-87f4-90fe1fd08d3e (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:41.960425 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Skip fixing resource ff5e57a2-0593-4db7-87f4-90fe1fd08d3e (type: routers). Resource does not exist in Neutron database anymore: neutron_lib.exceptions.l3.RouterNotFound: Router ff5e57a2-0593-4db7-87f4-90fe1fd08d3e could not be found Nov 21 15:34:41.960645 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 119af5ca-24a7-4385-a881-232e9e28b0cb (type: router_ports) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:42.035257 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-119af5ca-24a7-4385-a881-232e9e28b0cb, resource={'id': '119af5ca-24a7-4385-a881-232e9e28b0cb', 'name': '', 'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:f3:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b1e976d-d87b-4cac-a8ab-679986ea3a7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.6'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::35a'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005531460.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-21T20:33:03Z', 'updated_at': '2025-11-21T20:33:07Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.035577 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-119af5ca-24a7-4385-a881-232e9e28b0cb, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::35a/64', '172.24.5.6/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.035841 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=119af5ca-24a7-4385-a881-232e9e28b0cb, lrouter_port=lrp-119af5ca-24a7-4385-a881-232e9e28b0cb, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.066901 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 119af5ca-24a7-4385-a881-232e9e28b0cb (type: router_ports) to 5 Nov 21 15:34:42.067104 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 1921be29-1635-4cf3-8ac1-1e6d485a375e (type: router_ports) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:42.147881 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-1921be29-1635-4cf3-8ac1-1e6d485a375e, resource={'id': '1921be29-1635-4cf3-8ac1-1e6d485a375e', 'name': '', 'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'tenant_id': '', 'mac_address': 'fa:16:3e:27:7a:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8d89015a-68fb-4bce-8628-ae6c5a1549c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 723, 'fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.218'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::1ca'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005531460.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-21T20:33:19Z', 'updated_at': '2025-11-21T20:33:21Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.148014 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-1921be29-1635-4cf3-8ac1-1e6d485a375e, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.218/24', '2001:db8::1ca/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.148014 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=1921be29-1635-4cf3-8ac1-1e6d485a375e, lrouter_port=lrp-1921be29-1635-4cf3-8ac1-1e6d485a375e, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.175063 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 1921be29-1635-4cf3-8ac1-1e6d485a375e (type: router_ports) to 5 Nov 21 15:34:42.175231 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource b5898074-c7b2-4d89-a970-fbd7ae86da9f (type: router_ports) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:42.182373 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Skip fixing resource b5898074-c7b2-4d89-a970-fbd7ae86da9f (type: router_ports). Resource does not exist in Neutron database anymore: neutron_lib.exceptions.PortNotFound: Port b5898074-c7b2-4d89-a970-fbd7ae86da9f could not be found. Nov 21 15:34:42.182373 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 4745d69c-68d3-4af3-8272-3be066f36ca0 (type: router_ports) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:34:42.296532 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-4745d69c-68d3-4af3-8272-3be066f36ca0, resource={'id': '4745d69c-68d3-4af3-8272-3be066f36ca0', 'name': '', 'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'tenant_id': '', 'mac_address': 'fa:16:3e:16:f5:73', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3c97b04-1071-4209-9a72-0a55ea9de993', 'device_owner': 'network:router_gateway', 'standard_attr_id': 581, 'fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.172'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::155'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005531460.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-21T20:30:33Z', 'updated_at': '2025-11-21T20:30:35Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.296625 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-4745d69c-68d3-4af3-8272-3be066f36ca0, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-f3c97b04-1071-4209-9a72-0a55ea9de993'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::155/64', '172.24.5.172/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.296625 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=4745d69c-68d3-4af3-8272-3be066f36ca0, lrouter_port=lrp-4745d69c-68d3-4af3-8272-3be066f36ca0, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:42.331111 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Successfully bumped revision number for resource 4745d69c-68d3-4af3-8272-3be066f36ca0 (type: router_ports) to 5 Nov 21 15:34:42.331261 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 1f29262b-377e-42e6-ab48-10e77fa5fa0d (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.331703 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(1f29262b-377e-42e6-ab48-10e77fa5fa0d) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.345375 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 25b41ea4-20cc-4418-bc77-6aba1f7fc414 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.345695 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(25b41ea4-20cc-4418-bc77-6aba1f7fc414) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.353037 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 3990f211-bf17-4292-9c13-7a95509a4164 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.353270 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(3990f211-bf17-4292-9c13-7a95509a4164) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.358356 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 4c758934-a519-4466-8056-d166458a0414 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.358586 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(4c758934-a519-4466-8056-d166458a0414) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.362679 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 556f62de-de00-43b3-87d1-1555e899f74d (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.363358 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(556f62de-de00-43b3-87d1-1555e899f74d) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.369368 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 8d902c28-2db9-4ac4-b1ba-3b975bc360fb (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.369749 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(8d902c28-2db9-4ac4-b1ba-3b975bc360fb) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.375680 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 95c64618-829e-4385-9c2b-00fded1c2570 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.375927 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(95c64618-829e-4385-9c2b-00fded1c2570) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.382786 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource 9fe56e13-5003-4d78-9da7-e7e4bbc61148 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.382786 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(9fe56e13-5003-4d78-9da7-e7e4bbc61148) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.388830 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Fixing resource d8ac1f1e-8658-40bc-a93e-df847ea6096e (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:34:42.389050 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] delete_revision(d8ac1f1e-8658-40bc-a93e-df847ea6096e) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:34:42.393375 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ec96daf6-3b5e-4f13-b850-1bb6f5de37f8 None None] Maintenance task: Synchronization completed (took 1.02 seconds) Nov 21 15:34:42.934277 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=43f2760e-e3da-49ff-b979-c250c93c0465, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b', 'neutron:subnet_ids': 'c490705c-0e21-407f-8f7b-06871460a621'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:da:76:f2', name='lrp-602b5243-1c69-4968-aa70-e3735d213f89', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:42.937779 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-a1a5bee3-b50a-4473-9d0d-b681a6ce6edd, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:34:43.493433 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:34:43.494518 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:34:43.494518 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-4b1e976d-d87b-4cac-a8ab-679986ea3a7b Nov 21 15:34:43.494518 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:34:47.363309 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8a166826-ea25-43cd-9472-b9a4a543c60a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-87f4efc1-06d6-438a-b8e4-e4840253dec0', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[7d902b40-20ca-47fb-a5c6-255d68184290], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:bb:12:73', name='lrp-33af4a19-828a-4d9c-8b77-6b41459ae6dc', networks=['172.24.5.103/24', '2001:db8::275/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:49.184003 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=eff0ee6c-ef23-4e74-991d-8dc51336401d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-9647cc29-f1b2-41c6-a071-5b25613dddec', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-87f4efc1-06d6-438a-b8e4-e4840253dec0', 'neutron:subnet_ids': '086ddf51-7852-4d51-a02d-55c975d7aca7'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7f:19:23', name='lrp-286a3a39-3502-4f88-8d50-2ef7668e1482', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:49.223497 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-9647cc29-f1b2-41c6-a071-5b25613dddec synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:34:49.224474 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-9647cc29-f1b2-41c6-a071-5b25613dddec, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '9647cc29-f1b2-41c6-a071-5b25613dddec', 'neutron:router_id': '87f4efc1-06d6-438a-b8e4-e4840253dec0'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:49.231322 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-9647cc29-f1b2-41c6-a071-5b25613dddec, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:52.828639 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=203703ab-e344-4018-a1e8-97f2df8f1402, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fab102f6-62d8-48dd-ba49-ee94b691cd76', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[f4ae7f22-a053-48bd-8cae-1985e2bdb29c], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:5a:6d:45', name='lrp-97a5e8b8-28ff-4c03-addc-8294b648025d', networks=['172.24.5.249/24', '2001:db8::25/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:55.035378 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6b989de2-b56a-4b56-9f35-4ae9dd1e747c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fab102f6-62d8-48dd-ba49-ee94b691cd76', 'neutron:subnet_ids': '40374022-fe9f-491b-9781-c6223a58ef86'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:2f:b8', name='lrp-ef583ff8-3d4f-4468-bd44-86ad8500d6ff', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:34:55.093506 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:34:55.094937 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '3305a80b-0625-46e8-a49b-3f2fc6ba64a7', 'neutron:router_id': 'fab102f6-62d8-48dd-ba49-ee94b691cd76'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:34:55.094937 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:35:05.091240 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=648,neutron:UPDATE=11,neutron:DELETE=9 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:35:48.644754 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=eff0ee6c-ef23-4e74-991d-8dc51336401d, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-9647cc29-f1b2-41c6-a071-5b25613dddec', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-87f4efc1-06d6-438a-b8e4-e4840253dec0', 'neutron:subnet_ids': '086ddf51-7852-4d51-a02d-55c975d7aca7'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7f:19:23', name='lrp-286a3a39-3502-4f88-8d50-2ef7668e1482', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:35:48.645425 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-9647cc29-f1b2-41c6-a071-5b25613dddec, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-87f4efc1-06d6-438a-b8e4-e4840253dec0 Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:35:49.155073 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:35:49.155738 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:35:49.155738 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-87f4efc1-06d6-438a-b8e4-e4840253dec0 Nov 21 15:35:49.155738 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:35:53.182673 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3801f116-4b69-443f-a657-611cff9d0bef, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[86448732-8922-4aee-8af0-93436a8d0369], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:60:9f:be', name='lrp-2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81', networks=['172.24.5.198/24', '2001:db8::3b1/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:35:54.906794 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=521e22bf-cbd1-4677-a759-2c3060871739, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668', 'neutron:subnet_ids': 'c2f7768a-502a-4e7b-8acc-5683e21af9a4'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7b:80:32', name='lrp-a641c345-d922-48c0-806a-b31645d9a885', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:35:54.943888 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:35:54.944106 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '5ed0264f-3faa-4871-af77-7fdcb4ee7cba', 'neutron:router_id': 'ae2b5749-96e3-4ba5-ac6a-9426ef921668'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:35:54.944569 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:36:04.943526 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:37:49.771567 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d1df5a2f-ab6b-4c7b-9744-dc8f64c3a990, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-f3c97b04-1071-4209-9a72-0a55ea9de993', 'neutron:subnet_ids': 'e5fb57fa-fd4f-433c-a31f-7af99424af7f'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:dc:5f:41', name='lrp-75e99c94-e03d-4bb5-8401-fd79f48cd25b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:37:49.773009 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-a19e02ff-4103-4ccd-9547-b48bb56592e5, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f3c97b04-1071-4209-9a72-0a55ea9de993 Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:50.354930 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:37:50.355382 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:37:50.355382 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f3c97b04-1071-4209-9a72-0a55ea9de993 Nov 21 15:37:50.355382 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:37:53.262012 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=6b989de2-b56a-4b56-9f35-4ae9dd1e747c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-fab102f6-62d8-48dd-ba49-ee94b691cd76', 'neutron:subnet_ids': '40374022-fe9f-491b-9781-c6223a58ef86'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f3:2f:b8', name='lrp-ef583ff8-3d4f-4468-bd44-86ad8500d6ff', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:37:53.263629 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-3305a80b-0625-46e8-a49b-3f2fc6ba64a7, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:37:53.956076 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ef28f527-2d64-46d2-b289-2c5f1d0c6152, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-fb40917c-9be3-42f5-8549-cb76521b9d3b', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[f2fe9d43-2419-4d83-8ebf-8ea66eef0cdb], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:de:fc:89', name='lrp-9e0e63ab-bcaa-4a89-8372-ea95331b6400', networks=['172.24.5.104/24', '2001:db8::7f/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fab102f6-62d8-48dd-ba49-ee94b691cd76 Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:37:53.998999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:37:54.001829 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:37:54.001829 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fab102f6-62d8-48dd-ba49-ee94b691cd76 Nov 21 15:37:54.001829 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:37:57.637796 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1ae21cc8-0d1a-4a06-9e5c-27e3bb72eb6f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-2b054389-17e3-43ce-a88c-403d5b506f28', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-fb40917c-9be3-42f5-8549-cb76521b9d3b', 'neutron:subnet_ids': '9aa944fe-233f-4a50-95e0-4d78bff0c689'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:db:88:35', name='lrp-f2a4967b-f632-4ebe-954f-6bfa5416dc8d', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:37:57.689263 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-2b054389-17e3-43ce-a88c-403d5b506f28 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:37:57.689872 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-2b054389-17e3-43ce-a88c-403d5b506f28, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '2b054389-17e3-43ce-a88c-403d5b506f28', 'neutron:router_id': 'fb40917c-9be3-42f5-8549-cb76521b9d3b'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:37:57.690267 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-2b054389-17e3-43ce-a88c-403d5b506f28, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:38:07.687500 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:38:24.107507 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1ae21cc8-0d1a-4a06-9e5c-27e3bb72eb6f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-2b054389-17e3-43ce-a88c-403d5b506f28', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-fb40917c-9be3-42f5-8549-cb76521b9d3b', 'neutron:subnet_ids': '9aa944fe-233f-4a50-95e0-4d78bff0c689'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:db:88:35', name='lrp-f2a4967b-f632-4ebe-954f-6bfa5416dc8d', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:38:24.107507 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-2b054389-17e3-43ce-a88c-403d5b506f28, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fb40917c-9be3-42f5-8549-cb76521b9d3b Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:24.734022 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:38:24.735226 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:38:24.735226 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-fb40917c-9be3-42f5-8549-cb76521b9d3b Nov 21 15:38:24.735226 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:38:28.971868 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b8ef33a9-e2fb-49c6-ac73-145d9ebc30dc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e027a8c5-98b3-42a4-b5ce-2adb26766695', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[4a565530-6432-4323-b520-59811a16e8bd], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:3c:c3:05', name='lrp-9a28d940-9d4a-4b7f-8024-41cf3beaf006', networks=['172.24.5.94/24', '2001:db8::bb/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:38:31.096164 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=30af8bca-f8a2-4868-a572-a01995e727a7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b56025f6-80aa-4aa1-9924-686d021b78b8', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e027a8c5-98b3-42a4-b5ce-2adb26766695', 'neutron:subnet_ids': '87e51897-4c4b-48ac-8650-916c09cb88e8'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:24:ae:55', name='lrp-bfa33cbb-9670-4543-a284-a24b23f40044', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:38:31.132174 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-b56025f6-80aa-4aa1-9924-686d021b78b8 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:38:31.133292 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-b56025f6-80aa-4aa1-9924-686d021b78b8, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'b56025f6-80aa-4aa1-9924-686d021b78b8', 'neutron:router_id': 'e027a8c5-98b3-42a4-b5ce-2adb26766695'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:38:31.134839 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-b56025f6-80aa-4aa1-9924-686d021b78b8, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:38:41.131335 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:38:54.603417 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=30af8bca-f8a2-4868-a572-a01995e727a7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b56025f6-80aa-4aa1-9924-686d021b78b8', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-e027a8c5-98b3-42a4-b5ce-2adb26766695', 'neutron:subnet_ids': '87e51897-4c4b-48ac-8650-916c09cb88e8'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:24:ae:55', name='lrp-bfa33cbb-9670-4543-a284-a24b23f40044', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:38:54.604286 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-b56025f6-80aa-4aa1-9924-686d021b78b8, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e027a8c5-98b3-42a4-b5ce-2adb26766695 Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:38:55.244983 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:38:55.245494 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:38:55.245494 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e027a8c5-98b3-42a4-b5ce-2adb26766695 Nov 21 15:38:55.245494 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:38:58.994617 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3ad13193-56e1-4b10-b364-c36b260a4cbc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-894063d4-f0d0-4a7c-973a-16923f276556', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[7166aa32-4123-460c-b888-e23434260687], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0c:d7:fe', name='lrp-8361a00c-97f4-4ff8-b211-828314ff6276', networks=['172.24.5.82/24', '2001:db8::39f/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:39:00.459921 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b266faca-f38e-48d2-964b-8ab7b68966f7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b4874dce-135c-4981-96f6-383ab3f27c0e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-894063d4-f0d0-4a7c-973a-16923f276556', 'neutron:subnet_ids': '05cc2f00-36ce-4510-8eb4-f38d236e86be'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:4d:c4:d6', name='lrp-13ab7133-0969-4bd0-aec3-7ec60a63addb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:39:00.502818 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-b4874dce-135c-4981-96f6-383ab3f27c0e synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:39:00.503758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-b4874dce-135c-4981-96f6-383ab3f27c0e, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'b4874dce-135c-4981-96f6-383ab3f27c0e', 'neutron:router_id': '894063d4-f0d0-4a7c-973a-16923f276556'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:00.503758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-b4874dce-135c-4981-96f6-383ab3f27c0e, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:01.144019 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=44cfdde9-5dde-4fea-8340-5c60a2439f0b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7', 'neutron:subnet_ids': '5d1b83c2-8d82-4afe-a142-faf5293d45bf'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fb:c9:14', name='lrp-ca407d27-9a80-483d-a7dd-d1bb355c8e99', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:39:01.146581 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-8c6e2dfc-66cf-4042-a758-d3e82e07ced2, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7 Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:39:01.748656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:39:01.749296 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:39:01.749296 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-8d89015a-68fb-4bce-8628-ae6c5a1549c7 Nov 21 15:39:01.749296 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:39:06.046464 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=9b517dd5-9d0f-4c2e-a3d6-a9cb68d61e00, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-271221aa-5235-4b40-a010-015448062917', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[bb8f8639-5d61-4ed6-a4e7-f3818f62f778], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:5d:a0:cf', name='lrp-ea6a216a-5b51-400e-b09d-0e3cba8045a4', networks=['172.24.5.221/24', '2001:db8::4f/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:39:08.636188 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f29c2fe4-cb37-4312-8683-7be3849317d6, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-be150959-c026-425f-b3e4-14e96d4da2e0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-271221aa-5235-4b40-a010-015448062917', 'neutron:subnet_ids': '005b2f6e-264f-49ad-9850-16318d9dbb7d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ac:a8:a9', name='lrp-0f4e5528-2d54-4a32-96d1-050db385ef6a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:39:08.681821 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-be150959-c026-425f-b3e4-14e96d4da2e0 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:39:08.683262 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-be150959-c026-425f-b3e4-14e96d4da2e0, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'be150959-c026-425f-b3e4-14e96d4da2e0', 'neutron:router_id': '271221aa-5235-4b40-a010-015448062917'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:08.683568 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-be150959-c026-425f-b3e4-14e96d4da2e0, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:18.677252 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=34 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:39:41.366268 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=98566) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 21 15:39:41.377523 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 21 15:39:41.377627 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, security_groups=1, routers=1 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:39:41.377719 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Number of inconsistencies found at delete: router_ports=8 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:39:41.377840 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 5ed0264f-3faa-4871-af77-7fdcb4ee7cba (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:39:41.418458 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba, resource={'id': '5ed0264f-3faa-4871-af77-7fdcb4ee7cba', 'name': 'tempest-ServerActionsTestOtherB-639823522-network', 'tenant_id': '7bcae4b06f0d4fd3a3fe7bb668e318c4', 'project_id': '7bcae4b06f0d4fd3a3fe7bb668e318c4', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['c2f7768a-502a-4e7b-8acc-5683e21af9a4'], 'standard_attr_id': 798, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:35:50Z', 'updated_at': '2025-11-21T20:35:51Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17026}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.418633 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba, col_values=(('external_ids', {'neutron:network_name': 'tempest-ServerActionsTestOtherB-639823522-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.420352 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-583f1af3-2baa-4a76-a3f5-419c9358f8c6, external_ids_update=None, columns={'tag': 17026}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.458029 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Successfully bumped revision number for resource 5ed0264f-3faa-4871-af77-7fdcb4ee7cba (type: networks) to 2 Nov 21 15:39:41.458172 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 0067606e-d81d-42f2-a70e-e4fafa3446b6 (type: security_groups) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:39:41.475269 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Successfully bumped revision number for resource 0067606e-d81d-42f2-a70e-e4fafa3446b6 (type: security_groups) to 3 Nov 21 15:39:41.475407 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource ae2b5749-96e3-4ba5-ac6a-9426ef921668 (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:39:41.525796 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668, resource={'id': 'ae2b5749-96e3-4ba5-ac6a-9426ef921668', 'name': 'tempest-ServerActionsTestOtherB-639823522-router', 'tenant_id': '7bcae4b06f0d4fd3a3fe7bb668e318c4', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.198'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::3b1'}], 'enable_snat': True}, 'gw_port_id': '2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'ip_address': '172.24.5.198', 'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04'}, {'ip_address': '2001:db8::3b1', 'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-21T20:35:51Z', 'updated_at': '2025-11-21T20:35:54Z', 'revision_number': 3, 'project_id': '7bcae4b06f0d4fd3a3fe7bb668e318c4'}, resource_type=routers, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.526042 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668, columns={'external_ids': {'neutron:router_name': 'tempest-ServerActionsTestOtherB-639823522-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.526206 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.526348 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:39:41.563199 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Successfully bumped revision number for resource ae2b5749-96e3-4ba5-ac6a-9426ef921668 (type: routers) to 3 Nov 21 15:39:41.563298 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 119af5ca-24a7-4385-a881-232e9e28b0cb (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.563549 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(119af5ca-24a7-4385-a881-232e9e28b0cb) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.567513 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 1921be29-1635-4cf3-8ac1-1e6d485a375e (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.567672 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(1921be29-1635-4cf3-8ac1-1e6d485a375e) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.572894 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 33af4a19-828a-4d9c-8b77-6b41459ae6dc (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.573047 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(33af4a19-828a-4d9c-8b77-6b41459ae6dc) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.577838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 4745d69c-68d3-4af3-8272-3be066f36ca0 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.577838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(4745d69c-68d3-4af3-8272-3be066f36ca0) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.580084 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 97a5e8b8-28ff-4c03-addc-8294b648025d (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.580302 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(97a5e8b8-28ff-4c03-addc-8294b648025d) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.586021 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 9a28d940-9d4a-4b7f-8024-41cf3beaf006 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.586222 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(9a28d940-9d4a-4b7f-8024-41cf3beaf006) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.590393 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource 9e0e63ab-bcaa-4a89-8372-ea95331b6400 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.590637 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(9e0e63ab-bcaa-4a89-8372-ea95331b6400) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.594899 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Fixing resource b5898074-c7b2-4d89-a970-fbd7ae86da9f (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:39:41.595118 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] delete_revision(b5898074-c7b2-4d89-a970-fbd7ae86da9f) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:39:41.601538 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d680fc8c-6792-40e4-b166-272af472c58d None None] Maintenance task: Synchronization completed (took 0.22 seconds) Nov 21 15:39:51.598425 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=128,neutron:UPDATE=3,neutron:DELETE=8 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:40:14.091827 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=b266faca-f38e-48d2-964b-8ab7b68966f7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b4874dce-135c-4981-96f6-383ab3f27c0e', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-894063d4-f0d0-4a7c-973a-16923f276556', 'neutron:subnet_ids': '05cc2f00-36ce-4510-8eb4-f38d236e86be'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:4d:c4:d6', name='lrp-13ab7133-0969-4bd0-aec3-7ec60a63addb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:40:14.097118 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-b4874dce-135c-4981-96f6-383ab3f27c0e, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-894063d4-f0d0-4a7c-973a-16923f276556 Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:14.700758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:40:14.701326 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:40:14.701326 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-894063d4-f0d0-4a7c-973a-16923f276556 Nov 21 15:40:14.701326 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:40:17.933869 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=52bebb38-41d5-4565-a4a2-95f5c647e7c1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-eab22a07-d489-4da8-be2b-90eef08a3ad8', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[8b8d6536-18da-481a-9546-968eea4e572d], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ff:c4:12', name='lrp-26f42f71-4460-4860-be0c-0cdba19cef15', networks=['172.24.5.45/24', '2001:db8::2db/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:40:19.622464 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=29b3ff64-a277-466d-9398-b1df9b937687, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-eab22a07-d489-4da8-be2b-90eef08a3ad8', 'neutron:subnet_ids': '88242442-f26f-4d33-84f3-d5065a8576a3'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:eb:fa', name='lrp-b4cf232c-7ac8-44b4-867e-e6a8c4afbe71', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:40:19.664846 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:40:19.665279 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c', 'neutron:router_id': 'eab22a07-d489-4da8-be2b-90eef08a3ad8'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:40:19.665539 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:40:29.663707 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:40:41.594875 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f29c2fe4-cb37-4312-8683-7be3849317d6, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-be150959-c026-425f-b3e4-14e96d4da2e0', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-271221aa-5235-4b40-a010-015448062917', 'neutron:subnet_ids': '005b2f6e-264f-49ad-9850-16318d9dbb7d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ac:a8:a9', name='lrp-0f4e5528-2d54-4a32-96d1-050db385ef6a', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:40:41.597035 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-be150959-c026-425f-b3e4-14e96d4da2e0, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-271221aa-5235-4b40-a010-015448062917 Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:40:42.268758 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:40:42.269049 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:40:42.269049 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-271221aa-5235-4b40-a010-015448062917 Nov 21 15:40:42.269049 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:41:09.307295 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=29b3ff64-a277-466d-9398-b1df9b937687, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-eab22a07-d489-4da8-be2b-90eef08a3ad8', 'neutron:subnet_ids': '88242442-f26f-4d33-84f3-d5065a8576a3'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:eb:fa', name='lrp-b4cf232c-7ac8-44b4-867e-e6a8c4afbe71', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:41:09.310564 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-3ce0f9d3-967d-4ad2-93e1-fdd7e75ace4c, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-eab22a07-d489-4da8-be2b-90eef08a3ad8 Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:41:09.820370 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:41:09.820915 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:41:09.820915 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-eab22a07-d489-4da8-be2b-90eef08a3ad8 Nov 21 15:41:09.820915 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:42:05.902734 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=521e22bf-cbd1-4677-a759-2c3060871739, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668', 'neutron:subnet_ids': 'c2f7768a-502a-4e7b-8acc-5683e21af9a4'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:7b:80:32', name='lrp-a641c345-d922-48c0-806a-b31645d9a885', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:05.903195 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-5ed0264f-3faa-4871-af77-7fdcb4ee7cba, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668 Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:42:06.535453 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:42:06.535994 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:42:06.535994 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-ae2b5749-96e3-4ba5-ac6a-9426ef921668 Nov 21 15:42:06.535994 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:42:10.304505 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=df5a42cb-23d9-464d-a31b-3e07adbed3f0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-3ddb5822-fa80-495e-a6aa-edc9f98fc048', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[054f4974-b65d-48c0-9c6f-73e3866bff1a], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e7:64:82', name='lrp-1f6d5ee3-2b46-4c48-8c40-7be4e9b65299', networks=['172.24.5.247/24', '2001:db8::3ea/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:11.710980 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd0651e6-9ed6-49ff-b531-e00c3da6346a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-fb83e865-142b-4327-95f0-85df9956ebe4', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-3ddb5822-fa80-495e-a6aa-edc9f98fc048', 'neutron:subnet_ids': 'af107813-f1ae-4a74-991e-8763ea0d489d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ab:90:bb', name='lrp-c160ff3e-bc16-4523-b63d-01ef8b987ade', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:11.781249 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-fb83e865-142b-4327-95f0-85df9956ebe4 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:42:11.782055 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-fb83e865-142b-4327-95f0-85df9956ebe4, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'fb83e865-142b-4327-95f0-85df9956ebe4', 'neutron:router_id': '3ddb5822-fa80-495e-a6aa-edc9f98fc048'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:42:11.782600 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-fb83e865-142b-4327-95f0-85df9956ebe4, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:42:21.775552 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:42:56.039744 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=64d44a98-be21-460b-bc57-fa617b581506, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-e285f8cf-4d7b-41b7-9270-12ca2514ae1a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d8cc3933-60b4-49c4-b62e-00d5645b57cd', 'neutron:subnet_ids': 'c4c85d48-726d-4eb5-a9fb-0f16871cc3e8'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e7:d9:e7', name='lrp-e428b21e-c6fc-4476-9ab2-3253eaaa51e6', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:57.166672 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=701f8567-02bb-440d-80cd-8d3685b98ac4, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a6485c28-98d9-4fcd-8ebe-86b74744520e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d8cc3933-60b4-49c4-b62e-00d5645b57cd', 'neutron:subnet_ids': 'de100189-8d48-4de3-bde2-b1997ec3dbfa'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:65:aa:45', name='lrp-bb2b0bf4-8915-4e10-ae50-a7a1b570fa9a', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:58.147496 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=701f8567-02bb-440d-80cd-8d3685b98ac4, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a6485c28-98d9-4fcd-8ebe-86b74744520e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d8cc3933-60b4-49c4-b62e-00d5645b57cd', 'neutron:subnet_ids': 'de100189-8d48-4de3-bde2-b1997ec3dbfa'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:65:aa:45', name='lrp-bb2b0bf4-8915-4e10-ae50-a7a1b570fa9a', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:42:58.692277 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=64d44a98-be21-460b-bc57-fa617b581506, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-e285f8cf-4d7b-41b7-9270-12ca2514ae1a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-d8cc3933-60b4-49c4-b62e-00d5645b57cd', 'neutron:subnet_ids': 'c4c85d48-726d-4eb5-a9fb-0f16871cc3e8'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e7:d9:e7', name='lrp-e428b21e-c6fc-4476-9ab2-3253eaaa51e6', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:03.489198 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bcb657b1-44b2-4675-8a60-28b1013e695e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-44585141-0406-4d1f-bdc6-63d49c09ea7a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-2ba5f5be-79c8-4b75-9b0a-ff18cbf57a27', 'neutron:subnet_ids': 'c1a6c276-37f6-47bf-a14d-ee739bcf10c9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:de:93:e0', name='lrp-bfe5a68b-95a2-435d-89a1-b22e02a3f680', networks=['10.1.0.11/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:04.253549 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bcb657b1-44b2-4675-8a60-28b1013e695e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-44585141-0406-4d1f-bdc6-63d49c09ea7a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-2ba5f5be-79c8-4b75-9b0a-ff18cbf57a27', 'neutron:subnet_ids': 'c1a6c276-37f6-47bf-a14d-ee739bcf10c9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:de:93:e0', name='lrp-bfe5a68b-95a2-435d-89a1-b22e02a3f680', networks=['10.1.0.11/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:07.129404 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1843de94-a26a-4380-aa42-e7e9678ec483, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6456a9f7-2816-4b47-9813-d9e9cbf51713', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-64b7fee6-73df-49e6-8cc1-7b6b07883987', 'neutron:subnet_ids': 'ef872a1b-7466-46e7-8659-44451561c399'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:80:f1:d0', name='lrp-58fc1570-09a5-44f4-90d5-023dcac05847', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:08.779475 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1843de94-a26a-4380-aa42-e7e9678ec483, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6456a9f7-2816-4b47-9813-d9e9cbf51713', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-64b7fee6-73df-49e6-8cc1-7b6b07883987', 'neutron:subnet_ids': 'ef872a1b-7466-46e7-8659-44451561c399'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:80:f1:d0', name='lrp-58fc1570-09a5-44f4-90d5-023dcac05847', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:10.671299 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d1f2915f-2455-4a3d-a697-dd66afea4cdc, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-75e6ac89-322a-4ac6-9a16-6c80ab6d33a6', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[af54eea7-3ca3-42f8-a5a6-50cf9f242d4e], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:cb:9f:c8', name='lrp-1844710a-4cd4-478f-9b9f-0d5fff9fc5a9', networks=['172.24.5.202/24', '2001:db8::2c5/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-75e6ac89-322a-4ac6-9a16-6c80ab6d33a6 Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:11.854123 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:43:11.854805 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:43:11.854805 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-75e6ac89-322a-4ac6-9a16-6c80ab6d33a6 Nov 21 15:43:11.854805 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:43:12.170987 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=690c36aa-54c6-48c2-925e-9b6e20470d21, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-338eb7b8-2538-4155-ab00-2f410d26b97c', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[d41c8e8e-81f0-4c9c-a947-eeb80be9e24d], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fb:59:f2', name='lrp-e686068a-e3dd-4ed8-b772-df3c1d5b322e', networks=['172.24.5.113/24', '2001:db8::2a6/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:13.907486 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=35049e99-dbd2-4cbf-adf2-6cde05e2bebd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6d78608b-20a3-4153-9867-adf3b0026028', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-338eb7b8-2538-4155-ab00-2f410d26b97c', 'neutron:subnet_ids': '6e43451c-3867-41e7-9295-12b4a2deb856'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e3:39:bf', name='lrp-b79e8b81-8076-464f-809e-e10ab44a1f85', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:13.950100 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-6d78608b-20a3-4153-9867-adf3b0026028 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:43:13.951441 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-6d78608b-20a3-4153-9867-adf3b0026028, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '6d78608b-20a3-4153-9867-adf3b0026028', 'neutron:router_id': '338eb7b8-2538-4155-ab00-2f410d26b97c'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:13.951999 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-6d78608b-20a3-4153-9867-adf3b0026028, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:14.481663 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=fec889d1-cc32-47ff-a3e1-f727ea636bcb, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-77ddb15c-d6e8-4602-bddc-6b71a75b9e12', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8b816bb8-c6eb-42ae-91ee-6afe2089aa79', 'neutron:subnet_ids': 'c4b4b4ad-5962-4357-860d-405a2111d27d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d8:35:02', name='lrp-3c6ee1ec-7263-4748-8640-aa8b5eb616f5', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:19.785212 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=fec889d1-cc32-47ff-a3e1-f727ea636bcb, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-77ddb15c-d6e8-4602-bddc-6b71a75b9e12', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8b816bb8-c6eb-42ae-91ee-6afe2089aa79', 'neutron:subnet_ids': 'c4b4b4ad-5962-4357-860d-405a2111d27d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d8:35:02', name='lrp-3c6ee1ec-7263-4748-8640-aa8b5eb616f5', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:22.902477 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=31f11667-5ca9-49ba-8072-696a407c331f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-177fdcea-f456-4b98-849d-fa1b92c279fc', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '3f29e6e4-fe50-4a84-87de-e4fe263c404d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:07:25:51', name='lrp-683fe960-7de0-4302-8159-5ec92fbd2839', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:23.948225 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:43:25.717041 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7e48bfbc-d234-46da-9181-a7f2bcc71601, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c7788d3c-cbd3-4b76-8c42-cff9180977fc', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '25ba6f55-9323-4bb1-824d-bf99665a81b2'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:97:3a:54', name='lrp-5a02b994-e60f-41e6-9d6c-b0df06d6a179', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:27.540362 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=414d363f-16c3-49f7-bc7b-a14ee7577e4e, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-30a9bdab-256d-4bea-9d0d-cb3f5a4973c1', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[af91a0f4-1dec-4420-8c8f-2216c7d73a03], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:c8:2f:c7', name='lrp-d4a37d2b-e4ea-44e8-a0ce-0011becb4dbd', networks=['172.24.5.106/24', '2001:db8::185/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:28.581740 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=0e614bd0-ec17-4681-8d5c-7670aa90ec6a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1e9e4af0-6080-4c37-a873-53801bbc4d62', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '5915242a-6e91-4c24-b964-1682b45e2e94'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:94:c6:9b', name='lrp-bb884337-f5df-4d92-848e-eac0734331c5', networks=['10.1.32.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:28.857829 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd917855-5651-4627-9bd6-a5060328b9ca, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-30a9bdab-256d-4bea-9d0d-cb3f5a4973c1', 'neutron:subnet_ids': '9379e660-b4a6-42b6-9164-71bfecf5d9d1'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:da:93:f9', name='lrp-241602dd-84a4-4ed9-85ba-59a3f596eece', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:28.891380 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:43:28.892003 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3', 'neutron:router_id': '30a9bdab-256d-4bea-9d0d-cb3f5a4973c1'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:28.892280 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:30.663260 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=00ffda3a-cc45-44e3-9154-8a3050a11341, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-82466b0c-932a-4ccf-a23d-67e534a06fcf', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '09024551-c9fb-425a-9afc-37eeb3ee320a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b8:27:4d', name='lrp-e57df397-b1f1-4b61-9c83-2658546b7cff', networks=['10.1.48.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:31.190275 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd917855-5651-4627-9bd6-a5060328b9ca, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-30a9bdab-256d-4bea-9d0d-cb3f5a4973c1', 'neutron:subnet_ids': '9379e660-b4a6-42b6-9164-71bfecf5d9d1'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:da:93:f9', name='lrp-241602dd-84a4-4ed9-85ba-59a3f596eece', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:31.190995 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-69878d4e-15e5-40c9-ab1a-5ec7eaaa02e3, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-30a9bdab-256d-4bea-9d0d-cb3f5a4973c1 Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:31.699724 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:43:31.700246 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:43:31.700246 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-30a9bdab-256d-4bea-9d0d-cb3f5a4973c1 Nov 21 15:43:31.700246 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:43:34.051210 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=35049e99-dbd2-4cbf-adf2-6cde05e2bebd, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6d78608b-20a3-4153-9867-adf3b0026028', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-338eb7b8-2538-4155-ab00-2f410d26b97c', 'neutron:subnet_ids': '6e43451c-3867-41e7-9295-12b4a2deb856'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e3:39:bf', name='lrp-b79e8b81-8076-464f-809e-e10ab44a1f85', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:34.052580 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-6d78608b-20a3-4153-9867-adf3b0026028, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-338eb7b8-2538-4155-ab00-2f410d26b97c Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:34.607124 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:43:34.607656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:43:34.607656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-338eb7b8-2538-4155-ab00-2f410d26b97c Nov 21 15:43:34.607656 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:43:38.890061 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:43:44.983039 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=00ffda3a-cc45-44e3-9154-8a3050a11341, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-82466b0c-932a-4ccf-a23d-67e534a06fcf', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '09024551-c9fb-425a-9afc-37eeb3ee320a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b8:27:4d', name='lrp-e57df397-b1f1-4b61-9c83-2658546b7cff', networks=['10.1.48.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:46.145594 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=0e614bd0-ec17-4681-8d5c-7670aa90ec6a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1e9e4af0-6080-4c37-a873-53801bbc4d62', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '5915242a-6e91-4c24-b964-1682b45e2e94'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:94:c6:9b', name='lrp-bb884337-f5df-4d92-848e-eac0734331c5', networks=['10.1.32.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:47.294318 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7e48bfbc-d234-46da-9181-a7f2bcc71601, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-c7788d3c-cbd3-4b76-8c42-cff9180977fc', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '25ba6f55-9323-4bb1-824d-bf99665a81b2'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:97:3a:54', name='lrp-5a02b994-e60f-41e6-9d6c-b0df06d6a179', networks=['10.1.16.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:48.328332 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=31f11667-5ca9-49ba-8072-696a407c331f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-177fdcea-f456-4b98-849d-fa1b92c279fc', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-104cfc89-f1a7-4442-b1a1-591413c524f2', 'neutron:subnet_ids': '3f29e6e4-fe50-4a84-87de-e4fe263c404d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:07:25:51', name='lrp-683fe960-7de0-4302-8159-5ec92fbd2839', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:58.480920 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dd0651e6-9ed6-49ff-b531-e00c3da6346a, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-fb83e865-142b-4327-95f0-85df9956ebe4', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-3ddb5822-fa80-495e-a6aa-edc9f98fc048', 'neutron:subnet_ids': 'af107813-f1ae-4a74-991e-8763ea0d489d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:ab:90:bb', name='lrp-c160ff3e-bc16-4523-b63d-01ef8b987ade', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:43:58.482623 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-fb83e865-142b-4327-95f0-85df9956ebe4, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-3ddb5822-fa80-495e-a6aa-edc9f98fc048 Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:43:59.050745 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:43:59.051331 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:43:59.051331 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-3ddb5822-fa80-495e-a6aa-edc9f98fc048 Nov 21 15:43:59.051331 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:44:03.296917 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=a140693a-c1a8-45c3-93af-6f56aa4d90a4, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-73bc1083-292a-4e45-859e-8f33fcbfbe12', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[64a856a4-7d32-403b-90a7-e466c4e2eac5], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:0e:48:8f', name='lrp-07fb0d8e-c516-4459-bb0c-4e47c20aef62', networks=['172.24.5.205/24', '2001:db8::20c/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:04.849596 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c33169e7-b230-4578-8103-25fc89c2fec8, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-73bc1083-292a-4e45-859e-8f33fcbfbe12', 'neutron:subnet_ids': 'cedcb771-dcaa-45a4-854d-784cccee8e26'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:41:54:97', name='lrp-ab9557f6-7330-4b72-9fcb-c9918677529e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:04.887010 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:44:04.887010 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '6cfb86e3-c617-419f-9690-99c6d2642c5f', 'neutron:router_id': '73bc1083-292a-4e45-859e-8f33fcbfbe12'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:44:04.887376 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:44:09.925944 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=25d27ec3-fdcf-4d66-ab53-8e80018c504b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-eb7211c0-87a9-4a4d-8a7c-7ebf9b37ae20', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-95e6b089-83b6-4ff1-8b1f-89c235dc3cf7', 'neutron:subnet_ids': '8a6c745d-d2f1-4006-844b-ade6cbb1eba9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:19:57:7c', name='lrp-159df5bc-8f0a-4bfc-b4f5-f0896a2dc512', networks=['2001:db8::1c6/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:10.784437 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=25d27ec3-fdcf-4d66-ab53-8e80018c504b, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-eb7211c0-87a9-4a4d-8a7c-7ebf9b37ae20', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-95e6b089-83b6-4ff1-8b1f-89c235dc3cf7', 'neutron:subnet_ids': '8a6c745d-d2f1-4006-844b-ade6cbb1eba9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:19:57:7c', name='lrp-159df5bc-8f0a-4bfc-b4f5-f0896a2dc512', networks=['2001:db8::1c6/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:14.884917 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:44:41.368872 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=98566) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 21 15:44:41.379447 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 21 15:44:41.379548 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Number of inconsistencies found at delete: router_ports=8 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:44:41.379820 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource 1844710a-4cd4-478f-9b9f-0d5fff9fc5a9 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.379880 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(1844710a-4cd4-478f-9b9f-0d5fff9fc5a9) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.383901 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource 1f6d5ee3-2b46-4c48-8c40-7be4e9b65299 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.384056 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(1f6d5ee3-2b46-4c48-8c40-7be4e9b65299) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.391976 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource 26f42f71-4460-4860-be0c-0cdba19cef15 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.391976 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(26f42f71-4460-4860-be0c-0cdba19cef15) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.396153 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource 2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.396309 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(2a4e2c27-8ee5-45f3-b88c-73c24fa3aa81) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.402281 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource 8361a00c-97f4-4ff8-b211-828314ff6276 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.402374 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(8361a00c-97f4-4ff8-b211-828314ff6276) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.407808 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource d4a37d2b-e4ea-44e8-a0ce-0011becb4dbd (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.408122 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(d4a37d2b-e4ea-44e8-a0ce-0011becb4dbd) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.414285 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource e686068a-e3dd-4ed8-b772-df3c1d5b322e (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.414516 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(e686068a-e3dd-4ed8-b772-df3c1d5b322e) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.418515 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Fixing resource ea6a216a-5b51-400e-b09d-0e3cba8045a4 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:44:41.418667 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] delete_revision(ea6a216a-5b51-400e-b09d-0e3cba8045a4) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:44:41.422228 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae09be0a-9b5a-4373-a4ad-5eecf2bc957d None None] Maintenance task: Synchronization completed (took 0.04 seconds) Nov 21 15:44:41.877369 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1bcde080-12f2-41f9-98b9-8d88a9176215, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-faef3762-3a16-42a7-b495-dae905f4ba13', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[abf406d1-ae91-44a3-b884-0d524f022b33], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:39:e8:9e', name='lrp-ea4410b2-5f54-44d1-a3fe-bb78a8326b54', networks=['172.24.5.182/24', '2001:db8::106/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:45.285329 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f8832b9d-750a-4543-a77b-1a1397edc89c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-faef3762-3a16-42a7-b495-dae905f4ba13', 'neutron:subnet_ids': 'acf1f4dc-c4aa-4a09-8ce1-cbf809fd6f7d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:31:af:6b', name='lrp-09146d3c-9b1b-4a70-9173-06d363070413', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:45.332389 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:44:45.333786 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '61bfd0ff-0629-40bf-84f2-0c742aaa609d', 'neutron:router_id': 'faef3762-3a16-42a7-b495-dae905f4ba13'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:44:45.335693 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:44:51.706628 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d9dce258-5fbf-475e-8ace-e65889d015ab, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-32d1a057-5cc1-42bc-ae8c-89980af9bab8', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[4c7646ee-2cc6-4f3d-85ba-e16f44ee7b93], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:58:29:30', name='lrp-15d6d56b-834a-4bca-9ed1-bc704b0a3e3f', networks=['172.24.5.77/24', '2001:db8::1e5/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:54.266829 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ee58b53d-b2d1-403c-b477-828058ab7e08, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-32d1a057-5cc1-42bc-ae8c-89980af9bab8', 'neutron:subnet_ids': 'b9e84bf6-3464-4adf-9eaf-cfc5f931783c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e6:19:34', name='lrp-583b2b76-7474-467e-a1c5-49ad9d94f68b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:44:54.293564 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:44:54.294196 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '5482aa85-35ac-4644-a8d0-4e2fbf9de68a', 'neutron:router_id': '32d1a057-5cc1-42bc-ae8c-89980af9bab8'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:44:54.294704 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:45:04.292271 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=44,neutron:DELETE=8 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:46:04.446985 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ee58b53d-b2d1-403c-b477-828058ab7e08, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-32d1a057-5cc1-42bc-ae8c-89980af9bab8', 'neutron:subnet_ids': 'b9e84bf6-3464-4adf-9eaf-cfc5f931783c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e6:19:34', name='lrp-583b2b76-7474-467e-a1c5-49ad9d94f68b', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:46:04.447678 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-5482aa85-35ac-4644-a8d0-4e2fbf9de68a, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-32d1a057-5cc1-42bc-ae8c-89980af9bab8 Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:46:05.053119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:46:05.053411 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:46:05.053411 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-32d1a057-5cc1-42bc-ae8c-89980af9bab8 Nov 21 15:46:05.053411 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:46:08.989354 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=65376cfb-4be6-4cff-9e9c-100c6ce568c6, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e36b232b-5ab1-4740-a8ce-56537a525abe', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[4e058656-baa2-4bdc-9d61-e9f6f2d12714], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1f:d0:09', name='lrp-6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd', networks=['172.24.5.92/24', '2001:db8::22e/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:46:10.450642 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23a21721-379b-4f74-8b54-28ece17820e0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e36b232b-5ab1-4740-a8ce-56537a525abe', 'neutron:subnet_ids': '7aee91c7-7aaf-4b48-b74e-7d0c95c99743'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b0:66:6e', name='lrp-fdcc75a0-7f72-4cca-ab4f-1763828cbc61', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:46:10.495604 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:46:10.496448 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'de805c48-9e77-4bc9-8fc7-47a84dfbaeeb', 'neutron:router_id': 'e36b232b-5ab1-4740-a8ce-56537a525abe'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:46:10.496838 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:46:20.494541 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=17 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:48:19.060819 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f8832b9d-750a-4543-a77b-1a1397edc89c, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-faef3762-3a16-42a7-b495-dae905f4ba13', 'neutron:subnet_ids': 'acf1f4dc-c4aa-4a09-8ce1-cbf809fd6f7d'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:31:af:6b', name='lrp-09146d3c-9b1b-4a70-9173-06d363070413', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:48:19.062001 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-61bfd0ff-0629-40bf-84f2-0c742aaa609d, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-faef3762-3a16-42a7-b495-dae905f4ba13 Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:19.824346 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:48:19.825211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:48:19.825211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-faef3762-3a16-42a7-b495-dae905f4ba13 Nov 21 15:48:19.825211 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:48:37.137361 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c33169e7-b230-4578-8103-25fc89c2fec8, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-73bc1083-292a-4e45-859e-8f33fcbfbe12', 'neutron:subnet_ids': 'cedcb771-dcaa-45a4-854d-784cccee8e26'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:41:54:97', name='lrp-ab9557f6-7330-4b72-9fcb-c9918677529e', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:48:37.139531 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-6cfb86e3-c617-419f-9690-99c6d2642c5f, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-73bc1083-292a-4e45-859e-8f33fcbfbe12 Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:48:38.006566 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:48:38.007087 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:48:38.007087 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-73bc1083-292a-4e45-859e-8f33fcbfbe12 Nov 21 15:48:38.007087 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:49:41.368832 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=98566) _process_scheduled /usr/local/lib/python3.12/site-packages/futurist/periodics.py:638}} Nov 21 15:49:41.382664 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}} Nov 21 15:49:41.382664 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Number of inconsistencies found at create/update: networks=1, routers=1, router_ports=1 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:49:41.382664 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Number of inconsistencies found at delete: router_ports=3 {{(pid=98566) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}} Nov 21 15:49:41.382664 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource de805c48-9e77-4bc9-8fc7-47a84dfbaeeb (type: networks) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:49:41.430870 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb, resource={'id': 'de805c48-9e77-4bc9-8fc7-47a84dfbaeeb', 'name': 'tempest-VolumesBackupsTest-1162723558-network', 'tenant_id': '99dea2ee54874291a7a3284a115f81e4', 'project_id': '99dea2ee54874291a7a3284a115f81e4', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['7aee91c7-7aaf-4b48-b74e-7d0c95c99743'], 'standard_attr_id': 1837, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2025-11-21T20:46:06Z', 'updated_at': '2025-11-21T20:46:07Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 51733}, resource_type=networks, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.431313 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb, col_values=(('external_ids', {'neutron:network_name': 'tempest-VolumesBackupsTest-1162723558-network', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve', 'neutron:provnet-physical-network': ''}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.431845 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-85f8a5c9-9d2b-41e7-beaf-8f42d8a86c80, external_ids_update=None, columns={'tag': 51733}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.468809 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Successfully bumped revision number for resource de805c48-9e77-4bc9-8fc7-47a84dfbaeeb (type: networks) to 2 Nov 21 15:49:41.468809 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource e36b232b-5ab1-4740-a8ce-56537a525abe (type: routers) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:49:41.563175 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e36b232b-5ab1-4740-a8ce-56537a525abe, resource={'id': 'e36b232b-5ab1-4740-a8ce-56537a525abe', 'name': 'tempest-VolumesBackupsTest-1162723558-router', 'tenant_id': '99dea2ee54874291a7a3284a115f81e4', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.92'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::22e'}], 'enable_snat': True}, 'gw_port_id': '6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd', 'description': '', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'external_fixed_ips': [{'ip_address': '172.24.5.92', 'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04'}, {'ip_address': '2001:db8::22e', 'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2025-11-21T20:46:07Z', 'updated_at': '2025-11-21T20:46:09Z', 'revision_number': 3, 'project_id': '99dea2ee54874291a7a3284a115f81e4'}, resource_type=routers, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.563541 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-e36b232b-5ab1-4740-a8ce-56537a525abe, columns={'external_ids': {'neutron:router_name': 'tempest-VolumesBackupsTest-1162723558-router', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.563891 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.564164 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-951620d8-27c6-40cb-9882-7f9c887f390a, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd"')], if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.606059 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Successfully bumped revision number for resource e36b232b-5ab1-4740-a8ce-56537a525abe (type: routers) to 3 Nov 21 15:49:41.606059 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource 6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd (type: router_ports) at create/update {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}} Nov 21 15:49:41.726989 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd, resource={'id': '6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd', 'name': '', 'network_id': '951620d8-27c6-40cb-9882-7f9c887f390a', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:d0:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e36b232b-5ab1-4740-a8ce-56537a525abe', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1842, 'fixed_ips': [{'subnet_id': '36c6903e-e21f-4570-acb1-cbd0adb6ba04', 'ip_address': '172.24.5.92'}, {'subnet_id': 'a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'ip_address': '2001:db8::22e'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0005531460.novalocal', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2025-11-21T20:46:08Z', 'updated_at': '2025-11-21T20:46:09Z', 'revision_number': 5, 'project_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.727334 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-e36b232b-5ab1-4740-a8ce-56537a525abe'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.92/24', '2001:db8::22e/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.727809 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd, lrouter_port=lrp-6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:49:41.760235 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Successfully bumped revision number for resource 6ea8fee8-d32b-4f5e-9d54-6b1b0359ddbd (type: router_ports) to 5 Nov 21 15:49:41.760365 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource 07fb0d8e-c516-4459-bb0c-4e47c20aef62 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:49:41.760604 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] delete_revision(07fb0d8e-c516-4459-bb0c-4e47c20aef62) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:49:41.764004 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource 15d6d56b-834a-4bca-9ed1-bc704b0a3e3f (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:49:41.764203 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] delete_revision(15d6d56b-834a-4bca-9ed1-bc704b0a3e3f) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:49:41.767253 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Fixing resource ea4410b2-5f54-44d1-a3fe-bb78a8326b54 (type: router_ports) at delete {{(pid=98566) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:418}} Nov 21 15:49:41.767447 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG neutron.db.ovn_revision_numbers_db [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] delete_revision(ea4410b2-5f54-44d1-a3fe-bb78a8326b54) {{(pid=98566) delete_revision /opt/stack/neutron/neutron/db/ovn_revision_numbers_db.py:112}} Nov 21 15:49:41.770364 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a62dfa60-9cdb-4f60-9960-4ad584e2e744 None None] Maintenance task: Synchronization completed (took 0.39 seconds) Nov 21 15:49:51.769478 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=189,neutron:UPDATE=3,neutron:DELETE=3 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:49:58.321203 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d646888c-b409-4f2a-959c-797d393afeb7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-85a708d7-4664-4023-9efe-61d02875760d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e2972830-c301-4246-8763-415d8e925348', 'neutron:subnet_ids': 'cbeb439c-9ab4-4f83-864d-107fd167d02c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'dhcpv6_stateful', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:ba:54:eb', name='lrp-0bb1a932-f1aa-4684-9fda-5e9ce7e7a37b', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:49:59.197868 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d646888c-b409-4f2a-959c-797d393afeb7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-85a708d7-4664-4023-9efe-61d02875760d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-e2972830-c301-4246-8763-415d8e925348', 'neutron:subnet_ids': 'cbeb439c-9ab4-4f83-864d-107fd167d02c'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'dhcpv6_stateful', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:ba:54:eb', name='lrp-0bb1a932-f1aa-4684-9fda-5e9ce7e7a37b', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:50:00.968427 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=e01e2445-9fa0-4bae-b29f-5800ada35aa5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-85a708d7-4664-4023-9efe-61d02875760d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8db8ac2b-1242-437e-a777-2e3b4824f77e', 'neutron:subnet_ids': 'aeb91aea-cf1c-46c9-97aa-715109d6d6b9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fb:06:f0', name='lrp-6ef4d0ec-52ae-43b8-ba9a-75b55a9ee784', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:50:01.598957 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=e01e2445-9fa0-4bae-b29f-5800ada35aa5, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-85a708d7-4664-4023-9efe-61d02875760d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-8db8ac2b-1242-437e-a777-2e3b4824f77e', 'neutron:subnet_ids': 'aeb91aea-cf1c-46c9-97aa-715109d6d6b9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fb:06:f0', name='lrp-6ef4d0ec-52ae-43b8-ba9a-75b55a9ee784', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:30.488580 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7ad9440c-a881-45dc-9d44-c4f86bae8525, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6f11b8de-0203-4ad7-93e4-5fe86eb04b51', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-d1bf1650-0b02-4f7c-b4e0-a21472258664', 'neutron:subnet_ids': '745b662f-47d9-4111-a78e-a168af56c9f4'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:55:9b:1d', name='lrp-3b211001-87d9-4048-93aa-3d8c6a80382b', networks=['10.1.0.9/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:31.236543 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7ad9440c-a881-45dc-9d44-c4f86bae8525, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-6f11b8de-0203-4ad7-93e4-5fe86eb04b51', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-d1bf1650-0b02-4f7c-b4e0-a21472258664', 'neutron:subnet_ids': '745b662f-47d9-4111-a78e-a168af56c9f4'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:55:9b:1d', name='lrp-3b211001-87d9-4048-93aa-3d8c6a80382b', networks=['10.1.0.9/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:36.983061 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=23a21721-379b-4f74-8b54-28ece17820e0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-e36b232b-5ab1-4740-a8ce-56537a525abe', 'neutron:subnet_ids': '7aee91c7-7aaf-4b48-b74e-7d0c95c99743'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b0:66:6e', name='lrp-fdcc75a0-7f72-4cca-ab4f-1763828cbc61', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:36.994997 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-de805c48-9e77-4bc9-8fc7-47a84dfbaeeb, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e36b232b-5ab1-4740-a8ce-56537a525abe Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:51:37.637363 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:51:37.637608 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:51:37.637608 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-e36b232b-5ab1-4740-a8ce-56537a525abe Nov 21 15:51:37.637608 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:51:44.839567 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=055188d3-ecc4-4e83-bde3-392bb6f96835, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f2e085f3-74b5-4c01-8ca8-a018593ff043', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-cd1a049b-440b-43c6-9926-aa8ae0d071fa', 'neutron:subnet_ids': 'fdd18dd5-7ed2-4615-87c6-27f1a7c61049'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:90:13:24', name='lrp-cc9e56eb-dffa-4ca3-9611-131fcc4d9902', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:45.946923 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=be295a63-1975-49df-a17f-56377d5c75da, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-76711edc-7144-40b2-b831-a4f3510430cb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-cd1a049b-440b-43c6-9926-aa8ae0d071fa', 'neutron:subnet_ids': '84275bf5-aba0-4d72-92bd-3f93332c9a13'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:a0:2a', name='lrp-1477e5ba-8f08-4edf-8b33-faa83ce04247', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:52.024830 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=be295a63-1975-49df-a17f-56377d5c75da, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-76711edc-7144-40b2-b831-a4f3510430cb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-cd1a049b-440b-43c6-9926-aa8ae0d071fa', 'neutron:subnet_ids': '84275bf5-aba0-4d72-92bd-3f93332c9a13'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:b7:a0:2a', name='lrp-1477e5ba-8f08-4edf-8b33-faa83ce04247', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:52.537448 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=055188d3-ecc4-4e83-bde3-392bb6f96835, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f2e085f3-74b5-4c01-8ca8-a018593ff043', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-cd1a049b-440b-43c6-9926-aa8ae0d071fa', 'neutron:subnet_ids': 'fdd18dd5-7ed2-4615-87c6-27f1a7c61049'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:90:13:24', name='lrp-cc9e56eb-dffa-4ca3-9611-131fcc4d9902', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:57.066516 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ffb7eb0b-9a48-4d6a-a327-dbc25bff6ba2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-969f7300-b3b6-4f1f-806b-3917fd33e2af', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-be121a2e-0aa9-4572-8f52-2b140ce1cd55', 'neutron:subnet_ids': '8e8a2b4b-3443-48a0-9cfb-669c2ace8753'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:79:9e:1c', name='lrp-a994f345-35f1-4849-b7e7-4262524f281e', networks=['2001:db8::8e/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:51:57.572284 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ffb7eb0b-9a48-4d6a-a327-dbc25bff6ba2, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-969f7300-b3b6-4f1f-806b-3917fd33e2af', 'neutron:revision_number': '3', 'neutron:router_name': 'neutron-be121a2e-0aa9-4572-8f52-2b140ce1cd55', 'neutron:subnet_ids': '8e8a2b4b-3443-48a0-9cfb-669c2ace8753'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:79:9e:1c', name='lrp-a994f345-35f1-4849-b7e7-4262524f281e', networks=['2001:db8::8e/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:00.219362 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3cfc0489-3481-4b48-9e68-fa06e2c5c7d0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4d4024e4-2d85-49a2-904f-a4414cdbbfb0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-914fe37b-0cff-418e-8eff-ed249cf16473', 'neutron:subnet_ids': '8287228c-b43c-4f33-9933-250b0b0bc1a9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d9:49:f2', name='lrp-8d9b73af-d3ad-4345-a99c-435b774a0637', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:00.980728 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3cfc0489-3481-4b48-9e68-fa06e2c5c7d0, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4d4024e4-2d85-49a2-904f-a4414cdbbfb0', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-914fe37b-0cff-418e-8eff-ed249cf16473', 'neutron:subnet_ids': '8287228c-b43c-4f33-9933-250b0b0bc1a9'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d9:49:f2', name='lrp-8d9b73af-d3ad-4345-a99c-435b774a0637', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:02.918060 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=8091d41a-c7b2-474f-b428-1d904a6ffda7, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-0b10ef0a-2878-48ea-8f3c-9448cf1d58f3', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[89ca1211-b6d8-4aa1-8861-5dae6ba059a9], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:33:1a:4a', name='lrp-061fdd15-8256-4a02-bfee-3f1ce071173f', networks=['172.24.5.62/24', '2001:db8::36c/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-0b10ef0a-2878-48ea-8f3c-9448cf1d58f3 Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:52:04.411570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:52:04.413156 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:52:04.413156 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-0b10ef0a-2878-48ea-8f3c-9448cf1d58f3 Nov 21 15:52:04.413156 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:52:06.354336 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ed1ab965-9f29-416c-b204-ef1e91430077, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1da7cb45-1eb1-49c2-beee-e44e8bd6ebdd', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a154602d-31f6-4009-8436-f5bc57906405', 'neutron:subnet_ids': '07eaf781-0fc3-420c-8cb2-5c72401b973b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d3:8d:51', name='lrp-ab46ab7f-4395-4968-8f0c-3c81b34530f9', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:07.823382 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ed1ab965-9f29-416c-b204-ef1e91430077, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-1da7cb45-1eb1-49c2-beee-e44e8bd6ebdd', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-a154602d-31f6-4009-8436-f5bc57906405', 'neutron:subnet_ids': '07eaf781-0fc3-420c-8cb2-5c72401b973b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d3:8d:51', name='lrp-ab46ab7f-4395-4968-8f0c-3c81b34530f9', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:09.313589 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=f9727029-5c18-44e2-a158-94a526d8aa95, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b291a8cb-b254-483c-9920-338cc3ef65ec', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[9fcb004a-1452-4912-8477-c8f2c9dd7eeb], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1e:81:3f', name='lrp-57071545-a4d3-4748-b13d-c7f79b942df2', networks=['172.24.5.253/24', '2001:db8::c3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:11.232561 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=999b1cba-404b-4b70-95fd-01ff55bc214f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-b291a8cb-b254-483c-9920-338cc3ef65ec', 'neutron:subnet_ids': 'e5ccb5cb-d32b-44bb-90a9-e3a489ea0e92'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:db:03:1d', name='lrp-efd508f2-4597-4579-b731-59ac01f866eb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:11.268570 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:52:11.271014 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '72faf0df-2906-4b2a-ac3f-d1ad75438c43', 'neutron:router_id': 'b291a8cb-b254-483c-9920-338cc3ef65ec'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:52:11.272218 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:52:11.485962 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=57e494d7-efb7-49bc-82f7-04be57e2c728, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-002882f4-2ac7-40a1-984b-de09fa61d15e', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': '30cb4174-9ce2-45a7-87e9-c47f7277283a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1c:68:07', name='lrp-944c5add-6bb8-4d43-b9c4-fad9aea605ea', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:13.413055 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=cf6f5a48-49c5-49cd-80ba-2e25882b3849, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-d1ebf46a-26de-4df5-90c5-995fc67e389b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': 'd236746e-3151-4ddf-ad0f-939ba9fa0828'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d0:ed:38', name='lrp-ff8557d4-d34d-44a3-be29-7e83ff81e10e', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:15.220119 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7acb65a6-ce9e-4f10-b94d-387a937599f1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a7e3dfcf-57b7-4b80-9c0b-b4b9e8ade673', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': '3613d06b-7cc5-4204-a13e-ce82b5b061d5'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:32:38:a8', name='lrp-92769f7d-e7f9-4479-8107-ea895b19b3db', networks=['2001:db8:2::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:15.605169 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=dc2b345b-8105-47ea-aa3e-cafe252bb722, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-951620d8-27c6-40cb-9882-7f9c887f390a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f1e7e34e-16cf-477f-8f79-47ce37b9522f', 'neutron:subnet_ids': '36c6903e-e21f-4570-acb1-cbd0adb6ba04 a2cf5fb0-bb81-42ff-b0f2-26d1b23a98fc'}, gateway_chassis=[52c4d0a6-0314-4ddd-9715-9a61eacfdc79], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:de:9c:c4', name='lrp-2c322762-812c-4a55-9169-41a8d4703b9e', networks=['172.24.5.69/24', '2001:db8::6/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:16.940537 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1f4b6d91-769c-42ef-a538-64761879dfc9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-f1e7e34e-16cf-477f-8f79-47ce37b9522f', 'neutron:subnet_ids': '0678e13b-b81a-43f3-8cd4-e10bb3d2676b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f6:46:19', name='lrp-557aa979-1f4e-4fa6-a1f9-601aa3c159ec', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:17.202391 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6 synchronized; highest priority chassis ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3 Nov 21 15:52:17.202391 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '09c75fa1-4ac1-4461-b2ab-8cb6460c87f6', 'neutron:router_id': 'f1e7e34e-16cf-477f-8f79-47ce37b9522f'}}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:52:17.202752 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6, chassis=ba1042ba-54c6-4fe4-a9d7-1d44368fa9d3, priority=1, columns={}) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:52:19.626648 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=4748ec93-22ca-4f9b-b15e-b6f4f2040831, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f9da4102-f94b-4ce9-8a6d-2c28359a15e6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': 'b9d583fc-1cff-4647-b662-ca8e02a1c837'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:77:01:c4', name='lrp-716827ec-bb62-4766-b78c-bb2552238bf9', networks=['2001:db8:3::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:27.201053 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG dbcounter [-] [98566] Writing DB stats neutron:SELECT=34 {{(pid=98566) stat_writer /usr/local/lib/python3.12/site-packages/dbcounter.py:115}} Nov 21 15:52:32.249605 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=4748ec93-22ca-4f9b-b15e-b6f4f2040831, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-f9da4102-f94b-4ce9-8a6d-2c28359a15e6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': 'b9d583fc-1cff-4647-b662-ca8e02a1c837'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:77:01:c4', name='lrp-716827ec-bb62-4766-b78c-bb2552238bf9', networks=['2001:db8:3::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:33.449633 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=7acb65a6-ce9e-4f10-b94d-387a937599f1, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-a7e3dfcf-57b7-4b80-9c0b-b4b9e8ade673', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': '3613d06b-7cc5-4204-a13e-ce82b5b061d5'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:32:38:a8', name='lrp-92769f7d-e7f9-4479-8107-ea895b19b3db', networks=['2001:db8:2::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:34.554341 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=cf6f5a48-49c5-49cd-80ba-2e25882b3849, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-d1ebf46a-26de-4df5-90c5-995fc67e389b', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': 'd236746e-3151-4ddf-ad0f-939ba9fa0828'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d0:ed:38', name='lrp-ff8557d4-d34d-44a3-be29-7e83ff81e10e', networks=['2001:db8:1::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:52:35.418555 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=57e494d7-efb7-49bc-82f7-04be57e2c728, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-002882f4-2ac7-40a1-984b-de09fa61d15e', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-5573cbbd-3d87-4ecc-8194-839d0b3fe3c6', 'neutron:subnet_ids': '30cb4174-9ce2-45a7-87e9-c47f7277283a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:1c:68:07', name='lrp-944c5add-6bb8-4d43-b9c4-fad9aea605ea', networks=['2001:db8::1/64'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:53:38.028662 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=999b1cba-404b-4b70-95fd-01ff55bc214f, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-b291a8cb-b254-483c-9920-338cc3ef65ec', 'neutron:subnet_ids': 'e5ccb5cb-d32b-44bb-90a9-e3a489ea0e92'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:db:03:1d', name='lrp-efd508f2-4597-4579-b731-59ac01f866eb', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:53:38.030417 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-72faf0df-2906-4b2a-ac3f-d1ad75438c43, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b291a8cb-b254-483c-9920-338cc3ef65ec Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:38.838189 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:53:38.838709 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:53:38.838709 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-b291a8cb-b254-483c-9920-338cc3ef65ec Nov 21 15:53:38.838709 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Nov 21 15:53:40.449526 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1f4b6d91-769c-42ef-a538-64761879dfc9, dhcp_relay=[], enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6', 'neutron:revision_number': '2', 'neutron:router_name': 'neutron-f1e7e34e-16cf-477f-8f79-47ce37b9522f', 'neutron:subnet_ids': '0678e13b-b81a-43f3-8cd4-e10bb3d2676b'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f6:46:19', name='lrp-557aa979-1f4e-4fa6-a1f9-601aa3c159ec', networks=['10.1.0.1/28'], options={}, peer=[], status={}) old= {{(pid=98566) matches /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Nov 21 15:53:40.451931 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbRemoveCommand(_result=None, table=HA_Chassis_Group, record=neutron-09c75fa1-4ac1-4461-b2ab-8cb6460c87f6, column=external_ids, values=('neutron:router_id',), keyvalues={}, if_exists=False) {{(pid=98566) do_commit /usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event [-] Event not matched due to this exception: Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: : ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f1e7e34e-16cf-477f-8f79-47ce37b9522f Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event Traceback (most recent call last): Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/event.py", line 147, in match Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return candidate.matches(event, row, updates) Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py", line 53, in matches Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event if not self.match_fn(event, row, old): Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 47, in match_fn Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event lr = self.driver._nb_ovn.lookup('Logical_Router', lr_name) Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 184, in lookup Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event return self._lookup(table, record) Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 235, in _lookup Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event row = idlutils.row_by_value(self, rl.table, rl.column, record) Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 21 15:53:41.079720 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event File "/usr/local/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 116, in row_by_value Nov 21 15:53:41.080295 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event raise RowNotFound(table=table, col=column, match=match) Nov 21 15:53:41.080295 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Logical_Router with name=neutron-f1e7e34e-16cf-477f-8f79-47ce37b9522f Nov 21 15:53:41.080295 np0005531460.novalocal neutron-ovn-maintenance-worker[98566]: ERROR ovsdbapp.event